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EVALUATING A CURRICULUM FOR TEACHING THINKING AND WRITING 

(iMecuti ve Summdfy) 
Mary He Shann 



This report on the evaluation of the STEPS curriculum for teaching thinking 
skills and expository writing Is addrassed to several audlencesi the Waters 
Foundation which has supported development and formative evaluation of the 
curriculum; the curriculum developer and her consultants who have sought 
ways to Improve the curriculum and make it an attractive component of the 
language arts curriculum for middle and junior high scholsi the teachers 
and administrators from the school system who were willing to take risks and 
provide a field site for studying effects of the curriculum on teaching 
practices and on students' learnlngi and finally prospective users of the 
curriculum whose needs and goals may be similar to those of the field site. 

The STEPS curriculum Involves sequencing a task Into manageable steps to 
help students' overcome their lack of confidence In academic tasks, 
tspeclally writing. Worksheets. pu«les» word problems, stories with holes, 
and other mysteries are some of the exercises used Initially to help 
students read carefully and practice sequential thinking 1n a variety of 
conteKtSp Collecting and examining evidence, and forming and defending 
poitlons on controversial Issues receive major emphasis later In the course. 
Group discussions, brainstorming, organliatlon of Ideas, and outlining are 
done In conjunciton with writing essays. According to the developer, 
appropriate Implementation of STEPS requires that the teacher use keen 
diagnostic skills In a non-threatening, supportive environment to promote 
the development of students' confidence, endurance in writing assignments, 
and support for one another's ef forts. 

It had been difficult to obtain an appropriate fluid site willing to 
participate In significant program monitorlngt Interviewing of students and 
teachers, and collecting of writing samples In a pre-post control group 
design with rtpeated measures, A junior high school in an affluent suburb 
In the Greater Boston area agreed to participate. Four experimental Cn*»19| 
13| 17| 14) and two control classes (n^23i 26) were provided. Two 
experienced reading and language arts teachers were trained in the use of 
the STEPS curriculum. In each of the four experimental classes, they taught 
STEPS two days per week In a three-day-per week remedial course for students 
who had been evaluated by the school as performing one grade level of more 
below average in reading comprehension and writing skills. In lieu of this 
remedial course, the control students took a modern foreign language. Both 
txptrlmental and control students took English classes five days per week 
which were devoted largely to reading and interpretation of literature. The 
control students were more advantaged than the experiemntal students in that 
the former were not judged to be in need of remedial help in the language 
arts. 



As part of ths evaluation deslgnt writing tasks were asslnged to thi 
expariiiiental classes four times during the school year, and to the control 
classes only in Septembar and June, Four students were randomly selected 1r 
each of the six classes to participate in individual interviews with yrninec 
staffers who inquired the next day how the students approached the writing 
assignment, what he/she was thinking at various points, what classroof! 
experiences had been helpful, whether editing was attempted, and ho¥ 
satisfied the student was with the paper. The 16 students constlty ted casi 
studies of progress In writing over the school year. End-of-coursi 
evaluations were given only to STEPS studentst six randomly selected frott 
each class who were not already part of the special case studies. 
Structured and informal teacher Interviews, logs, telephone conferences, and 
class records were also used In the evaluation* 

The writing samples were evaluated through primary trait scoring. After 
training and practice trials, interrater reliability among three judgei 
working indtpendently approached 1001. Chi square tests revealed that on 
the first writing assignment, the control students scored significantly tha.t 
the remedial STEPS students ( ^ 24.78, df ^ 3, p < •0001). On the last 
writing task administerid in June, STEPS students averaged slightly higher 
than the mean for the control group, but the difference was not 
significant. This was interpreted to mean that the STEPS group benefited 
from their instruction for thinking and expressing oneself clearly In 
writing, and that the curriculum was effective In closing the gap between 
the remedial and the more advantaged college-bound students. 

The Interviews with students revealed the procedures and thought processes 
they used to attack the assignments. The interviews were also helpful for 
pointing out what the students thought were the most beneficial learning 
actlvltlesi analysis of interview data in conjunction with writing samples 
also underscores the strong influence of interest and prior knowledge for 
students' success in a writing task. End of course evaluations provided 
more holistic views from students about the STEPS curriculum, much of which 
was complementary and most of which was very insightful. Even remedial 
students can reflect carefully on their needs and express them to an 
interested listener. Conversations with teachers and more formal interviews 
were used to ask about many of the same Issues from the teachers' 
perspectives, 

Reeormnendatlons are provided on several issuesi on curriculum developmenti 
on teacher training; on Improving students* leai^ning and proficiency in 
writing! and on marketing and dissemination of STEPS. One of the greatest 
benefits which teachers cited from participation In STEPS was their 
heightened sense of protesslonalism. 

Appendices are included which Illustrate questions for the evaluation desigii 
and sources of information, the writing tasks, primary trait scoring scales, 
writing process intervitws, and student and teacher interviews. 
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PART 1.5 CONTIXT FOR THE EVALUATI 



ON 



INTRODUCTION 

This doeument provides a report on the evaluation of 
STEPS, the Waters Foundation Curriculum for teaching thinking 
skills and expository writing. The data for this evaluation 
report were collected during the 1983-84 academic year, a time in 
the evolution of the STEPS curriculum when the purposes and shape 
of the curriculum were crystalliainf, when firm institutional 
coiiunitments ensured a cooperative field site for testing the 
curriculum, and when previous STEPS evaluations and research on 
teaching and learning enabled us to focus new efforts on informed 
luestions with promising techniques for inquiry. 

This account is the first major report on the evaluation of 
BTEPS in five years. Initial sections of the report attempt to 
lummariie the maturation which has taken place in the STEPS 
mrrlculum since 1980, the history of Implementation at previous 
:ield sites, and the results of earlier formative evaluations of 
uia STEPS program. Then, the design and rationale for the 1983-84 
tvaluation are presented. Multiple sources of Information were 
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used to detennine how the STEPS curriculum was uead, what was ^ 
achi^vd, and why. Next, th« results are presented and discussed.. 
Finally, recommendations are given for further refinements in the 
materials and for the publication, marketing, and dissemination of 
STEPS nationally. 
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BACKGROUND OP STEPS D1\^L0PM1NT AND IMPLEMENTATION 



Mrs. Faith P. Waters launched the STEPS curriculum in 1975. 
AS a reading specialist in a Boston area secondary school, she was 
confronted daily with students who were unable to meet the 
academie expectations Of their classes. Using her experience as a 
teacher, diagnostician, and adult learner, she designed an 
interdiscipUnary, process curriculum to improve her students' 
skills in oral and written eommunication, critical thinking, and 
problem solving. Mrs. Waters named the curriculum "Sequential 
thinking for Educational Problem Solving," fitting it to the 
acronym "STEPS" which reflected her systematic and direct approach 
to diagnosing and responding to learning difficulties. 

Starting with what the student does well, the STEPS approach 
involves sequencing a task into manageable steps to overcome the 
student's lack of confidence and "blocking" which may have 
resulted from previous, often repeated failures. Worksheets, 
puzzles, word problems, math problems, stories with holes, and 
other mysteries are some of the exercises used initially to help 
students read carefully and practice sequential thinking in a 
variety of eontsxts. Collecting and examining evidence, and 
forming and defending positions on controversial issues receiv© 
major emphases later in the course. Group discussions, 
brainstroming, organization of Ideas, and outlining are done in 
eon junction with essay writing. Appropriate 1' plementation of 



STEPS requires that the teacher use ketn diagnostle skill, in 
non-threatening, supportive enviromnant to promote the devalopment 
: of students, confidence, enduranee, and stamna; as well as their 
support for one another. 

By Saptenier, 1979; Mrs. Waters had developed the iTlPS 
curriculum materials and documented the teaching/learning 
strategies sufficLntly so that other teachers could be trained to 
^:sa the program. Two schools agreed to pilot test the STEPS 
curriculum, one was the alternative high school in a working 
class,, urban coimnunity adjacent to Boston ^ere tes. Waters had 
first tried STEPS. The second school was a public junior high 
school in an affluent suburb west of loston. Wiat both field 
sites had in conmon were STEPS classes of ninth graders scoring 
two or more years below grade level on standardized tests of 
reading achievement. 

At this point in ^he history of STEPS development, it was 
apparent that more extensive implementation and field testing of 
STEPS would require substantially more financial support and would 
be aided considerably if the materialM were ready for commercial 
production and marketing. The next time field testing and 
formative evaluation took place was the 1983-84 academic year, 
whose results are the subject of the present report, m the 
intervening years between 1980 and 1913, Mrs. Waters revised and 
refined the curriculum extensively using feedback from teachers 
and advice from curriculum consultants, other experienced 
educators, and prospective publishers. 



The revised draft of the curriculum no longer emphaslE.a its 
broad, intardlsclplinary applications but focused more on its 
Plaeement in the language arts sequence. Literature components 
might be joined to the STlPS Curriculum but the major claim would 
be the development of thinking strategies for approaching a 
variety of academic and real life problems systematically and with 
confidence. Students 's success would be sho^ in well-organiied, 
effective, expository writing. 
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IlfiSULTS OF PREVIOUS STEPS EVALUATION 



The 1979-80 ovaluatlon o£ the STEPS curriculuni was 
exploratory and formative in nature, consistent with the early 
stages of development of the curriculum. The plan for the 
evaluation was an «quivalent time samples, quaai axporimental 
design with repeated observations in each of four treatment 
groups— two teachtrs in different schools using the curriculum 
a one-semester coaree in both the first and second semesters of 
the academic year. As noted earlier, the two school districts 
which offered pilot aites for the STEPS curriculum differed 
drammatically in socioeconomic status, but in all classes the 
sample students were judged educationally at risk because they 
tested two or more years below grade level on standardized readi 
testa. 

A wealth of qualitative data waa collected in all four aamf 
classes: interviews with steps students; the evaluator's and Mr 
Waters' notes from classroom observationsi notes from telephone 
conversation with STEPS teachersi minutes from staff meetings^ 
written comunication to the evaluator from STEPS teachersi the 
teachers' logs and Mrs. Waters' comments on those logs? and the 
students' test papers, esnays, and written responses to a 
questionnaire soliciting their evaluation of the course. The 
evaluator read and reread the information from the variety of 
sources to determine points of eonsenjus, to check the perceptioj 



13 



- 7 - 

of one group against another, and to "tost" alternate hypotheaes 
through the dat« to determine which wssro best supported by the 
data. In Qxamininf the data, the avaluator queotionad whether 
different pattorna emerged, parhapo owing to differencos in 
demographic profilee of the two eommunitieBj degree of student 
choice in taking the coursei teachor axporience with stepsi 
teaching style in othar courseBi or openneaa of the larger school 
anvironment. in this evaluator's judgement, the two school sites 
and the two teachers could be readily disting uiahed on any of the 
charaeterifltics above, yet several important tronda persiated, 
regardleas of the field site, the teacher, the interviewer, or the 
source of Information. 

Students claimed to be more active participants in STEPS 
classroom activities than in the other courBes they take, even 
courses with the same "STEPS" teachers teaching other subjects. 
The students noted the growth in their abilities to tackle more 
difficult writing assignmentS"knowing how to get started, 
organizing ideas, and expressing their thoughts more fluently on 
paper. STEPS students remarked that they liked being able to 
discuss their ideas with classmates,* it helped them to clarify 
their thinking, consider another point of view, gather new 
information in support of their own position, and present and 
defend their own thinking more effectively and in greater 
detail. 
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Teaching etrategios associated with these outcomoa were noted 
by teochors and studonts alike. Sometimes the students could r.ny 
only that steps teaching is different, without being able to 
explain the nature of the difference. However, toachers noted 
elearly how th« STEPS curriculum foaterad or reinforced clear 
patterns of behavjor for themi breaking down diffloult taakB into 
manageable piecosi Uilng practice exerciies to illuBtrate thought 
processes or develop fluency of words and ideasi noting the 
flequence of steps? creating an envlronmant in which it was "OK" to 
wake and correct mistakes, and encouraging students to help others 
and in the porcese httlp themselves. The currciculum placed the 
teachers in a demanding but highly safisfying role, and made them 
more conscious of their teaching behaviors. 
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THE STEPS EVALUATION DESIGN FOR 198 3-1984 



Rationale 

The 1983-84 academic year marked the first time in the 
development of STEPS that a comprehensive and controlled 
evaluation of the STfiPS curriculum could be done. Objectives for 
the curriculum had matured with an expressed focus on writing as 
an IndeK =u clear thinking. Previous evaluations had relied 
hbavily on interviews with studenta and toachers to gauge the 
cognitive and affective benefits of the curriculum, it was time 
to complement these qualitative approaches to evaluation with a 
more objective assessment of the curriculum's effects— a pre-post 
control group design using students' actual performance on writing 
tasks as the criterion measures. 

During the previous year, the STEPS development team had 
begun discussions with teachers and administrators at a suburban 
junior high school which was considering the adoption the STEPS 
curriculum. STEPS became a major component In the language arts 
program for eighth graders who needed remedial Instruction in 
reading and writing. These students took the STEPS curriculum in 
addition to their English literature course, but instead of 
instruction In a foreign language. 

The school agreed to permit the assignment of writing tasks 
to two control classes which would be used for purposes of 
comparison! they also allowed that randomly selected students in 
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thosQ cUbbob eould be interviewed about their writing. More 
frequent writing eamples and corresponding intervi#wa of aontrol 
students would. not be permitted. And, in a time of national 
debate about teacher offectlvenose and merit pay, it was thought 
that the purpose of repeated observations of the control classes 
might be miainterpreted and thus jeopardize the entire evaluation 



effort. 



The teachers of the experimental groups, who were involved 
regularly in discussions about the curriculum and its use, did not 
seem tp be threatened by the evaluation activities. EKtensive 
data collection was permitted in the #xperimental claasea. An 
outline of the ^.valuation design is contained in Table 1. All of 
the data was collected as planned with the exception of the 
classroom observation schedules. The evaluation asiistan^ ware 
advised to give priority to the collection of writing samples and 
the conduct of writing process interviews with STEPS and non-STEPS 
students. It was not possible to accommodate the atudents* class 
scheduleF for the purpose of interviewing and apply the 
observation system as well, m addition, a choice had to be made 
regarding time for training to score and for actually scoring the 
writing samples versus time to train and apply the observation 
system. Again the decision was made in favor of the writing 
assessment because it was the only opportunity to gather much 
needed comparative data on writing performances of STEPS and non- 
STEPS students. 
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Sarnp la 

The field site ovalXable to tho STEPS curriculufn was a 
junior high school in an affluent suburb in the Greater Boston 
area. The school's program had two tracts, for college-bound ond 
non-college bounj students* Pour experimental and two control 
Glasses would be provided. The number of students in each of 
these classes is given in Table 1. 

Ex pe r ime n t a 1 C 1 a a 8 e s 

There were two experienced reading and language arts 
teachers trained in the use of the STEPS curriculum. The adoption 
plan called for them to use STEPS two equivalent days per week in 
the threa-days-per-week remedial course i they would attend to 
reading aasignments the remaining time. One teacher had one class 
of STEPS students while the other taught three STEPS classes, all 
at the eighth-grade level. In each of the four exparimental 
classes the students had been evaluated by the school as 
performing below grade level in reading comprehension and writing 
skills. They were "mainstreamed" with more able non-college- 
bound students in the schoc'a regular eighth-grade English 
classes which met five days per week. 
Control Classes 

The control group was comprised of non-STEPS students in 
two eighth-grade English classes in the college-bound tract. 
Their English classes also met five times per week and were taught 
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TABU 1 

OUTLINE OF THE EVALUATION DESIGN 



ExpeHmental (STLPS) Classes Control Classas 

Data Teachif A Teacher B Teacher C 

Conictlon clasi 1 Class 2 Class 3 Class 4 Class S Cless 6 

n"19 n"13 n"17 n*14 n"23 n-26 

Writing Tasks and 
Primary Trait Scoring 

September X X X * XX 

December X X X 5 

^prll/May X X X X 

•Jwne X X X X XX 

Thinklng/Wrlting 
Process Interviews 
(4 S's per elass) 

September X X X X XX 

December X X X X 

April/May X X X X 

•June X X X X XX 

Classroom Obiervatlons 
with rruDEffTS System 
In STEPS and non-STEPS 
portions of curriculum 

October XX XX XX XX 

January XX XX XX XX 

Mareh XX XX XX XX 

May XXXXXXXX 

Course Evaluation 
Interviews 

(6 S's ptr cltss) X C X X 

Ttacher Legs and 

Informal /Telephone X X X X 

Confifencts 



Structured Teacher 
Interview (May) 



NOTE.— THE CLASSROOM OBSERVATIONS COULD NOT BE 
COMPLETED AS PLANNED 
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by an exporiencQd teacher. The control students were more 
Advantaged than the experimental etudonts in that the former were 
not judgfld to be in need of remedial help in the language arts. 
For both experlmantal and control students, instruction in English 
clasees was largely devoted to reading and interpretation of 
literature. Tha axperimental students had remedial aosistance 
with STEPS, while the control students used a comparable amount of 
time in their academic program for instruction in a foreign 
langufige. 

Questio ns Addressed by the Evaluation 

Improvements in the STEPS curriculum, clarification of its 

goale, results of previous evaluatione, and the availability of an 
optimal field site all helped to sharpen the focus of the 
questions which could be asked by the 1983-84 evaluation. The 
types of questions for 1983-84 moved from the realm of description 
and general inquiry toward the level of identifying what learning 
experiences were associated with Improved thinking and writing and 
why. In addition, some comparative analyses could be used since 
control classes were available for the first time. A list of 
guestions which guided the conduct of the evaluation is provided 
in Appendix A, 
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Spur 06 8 of pa t a 

Multiple indices were usoa to gauge the effeets of tho STEPS 
curriculum and to chock percepta about how the curriculum was 
being uaed. These included atudent and teacher interviews; 
students' writing samples? elassrooin observations,- and formal and 
Informal conferences with teachers , administrators, and the STEPS 
developers. In Appendix A, the sources of data are shown in 
relation to the questions which each was intended to address. The 
application of these sources, or instruments for data collection, 
are ateo given in the evaluation design outlined in Table 1. The 
discussion of these instruments and the results obtained with 
each fellows the order in which they are presented in Table 1. 
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PART II. I INSTRUMENTS AND RESULTS 



WRITING TASKS AND PRIMARY TRAIT SCORING 



From its inception, STEPS was designed as a curriculum for 
teaching thinking skills,, the emergence of writing as a critical 
manifestation of clear thinking warranted the efforts which would 
be required to focus the 1983-84 evaluation on students' actual 
performance in expository writing. 

Since 1969, the National Assessment of Educational Progress 
(NAEP) has led the way in advances in methodological research and 
practice in the maasurment and scoring of writing achievement. 
The STEPS developers and evaluator agreed to follow that lead. 
The NAEP exercises provided suitable models for the creation of 
clear writing tasks which might enable reliable and valid results. 
Of the scoring approaches applied by NAEP— holistic scoring, 
primary trait scoring, and scoring of cohesion, syntax and 
mechanics— the method of primary trait scoring provided the best 
fit to the use of writing which the STEPS curriculum sought to 
develop. 

Four writing exercises were developed by Dr. Margaret 
McNeill whose expertise includes curriculum development and 
measurement as well as project management and supervision. In 
consultation with the STEPS developer, teachers, and evaluator, 
she reviewed the proposed topics and refined the writing tasks. 
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Assignments were oought which would build on the intarest and 
prior knowledge of the students and would stress organization, 
thoughtful presentation of ideas and/or parsuasion. Topics of the 
four exerciees and their primary traits are listed below. 

TasO- Letter on Policy for Watching t.v. 

The PTO asked your principal to recommend to parents a 
policy about students- watching TV on week nights. Before 
he makes his policy, he wants to hear from the students. 
Write a brief letter to the principal describing the reasons 
for and against allowing students to watch television on 
week nights. Then describe what polioy you would recommend. 
Give reasons for your recommendations. 

Primary trait s Persuasion through invention and defense of 
a policy that is linked to a balanced presentation of the 
pros and cons of allowing students to watch television on 
week nights. 



Task 2 t Essay on Movie Ratings 

A rating system now exists for movies. Restrictions are 
placed on movie viewers according to age. Write an essay 
explaining why you think the rating system is important or 
why you think it should be changed. This will be an opinion 
essay. Decide whether you want to start with the least 
important idea and build up to you strongest. Consider 
giving the strongest argument first. 
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Primary trait i Expression of an opinion on a social issue 
supported by sevaral thoughtful reasons tnat are organized 
to reveal their relative importance. 

TasU 3 ; Essay on videogames 

Write an essay presenting your opinion on one of the issues 
surrounding videogames. Show how the data collected from 
the class questionnaire supported your opinion, changed your 
opinion, or disagreed with your opinion but did not change 
'it. 

Primary trait t Reaaonad presentation of an 
opinion/hypothesis about aocial behavior and a clear, 
thoughtful discussion of the role of researeh data in 
reinforcing, modifying, or changing the hypothesis/opinion. 

Task 4 1 Recommendation on Class Trip. 
Write a latter to the House Leaders describing your 
impressions of what New York City offers and of what 
Washington, D.c. offers to visiting students. Then indicate 
your recommendation for which city or cities should be 
Included in next year's trip. Give reasons for your 
recommendation . 

Primary trait i Persuasion through invention and defense of 
a recommendation linked to a thoughtful discussion of the 
alternatives. 
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in addition to tho task, and priory traits, a rational, was 
developod for th« primary trait, and a general orientation was 
given for scoring. Then, following tho NAEP .odel, a scoring 
guide was created, providing detailed descriptions of the 
possible scores. The writing exercises and primary trait scoring 
9«i-e. for each of the four assignments are given in Appendix B 

TWO evaluation assistants were trained by Dr. McNeill m the 
use Of the scoring systems. Each of these three Individuals 
scored every paper independently and the group reconvened to 
compare scores. In the cases of discrepancies in score, assigned 
to a paper, the three discussed reasons for assigning the scores 
and came to a concensus on a score for each of the disputed 
papers, 

Results Of the scoring are given in Table 2. The time which 
would have been required for administration of the second and 
third writing tasX. to the control classes was considered 
prohibitive by the school, so the evaluation design could Include 
experimental and control group comparisons only on the first and 
fourth writing tas.s. Chi square tests were used to determine the 
significance of differences between the distributions of writing 
scores. (This nonparametrlc technique required no assumptions 
.bout the Shape of the distribution or the comparability of score. 

across tasks which the more Bowerful i-an^a*-^^ 

re powerful repeated measures ANOVA would 

have required.) 
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TABLE 2 



IJjfILfif*f^^"i -S"' °* Writing As.aiBment Scores for STEPS 
Experimental and Control Clasaea and Chi Square Tasta of 
Significance of Differtnoes in Group Dist^ibutilni 



T&uk 1: 
Letter to 
Principal 
on TV Policy 



Score 



1 

2 
3 
4 



STEPS ClasBes 



n"59 
66.11 



27, 
6, 
0 



1% 
81 



Control ClasBes 



n«46 
26.11 
41.31 
28.3% 
4.3% 



Chi 

Square 



24.78 
df-3 
P<,0001 



Task 2 1 
Essay on 
Movie 
Ratings 



1 
2 
3 
4 



n"S7 
43.9% 
47.4% 
7.01 
1.8% 



Not assigned 



Task 3: 
Essay on 
Video 
Games 



1 
2 
3 
4 



n-S2 
32.7% 
51.91 
11.5% 
3.8% 



Not assigned 



Task 4 1 
Reccmmenda' 
tion on 
Class Trip 



1 
2 
3 
4 



n«S8 
33.3% 
38.6% 
21.1% 
7.0% 



n»40 

37.5% 

40.0% 

10.0% 

12.5% 



N.S, 
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The Chi square for significance of differoncea in tho 
diBtributioni of STEPS and control group scores on tho first 
writing activity was highly significant, at p<.0001. Examination 
of the percentage distributions for task 1 in Tablo 2 shows that 
tho control group posted significantly more scores at the uppar 
ratings than the STEPS group. 

The differences «r« also shown in Table 3, whore percentages 
from the raw score points are grouped according to the score 
iftterpretatiens employed by mwPi scores of 1 or zero were 
conflitferod be -below marginal," and 8cor«8 2, 3, and 4 were 
termed -marginal or better." Not surpriaingly for a group of 
students judged to be in need of remedial assiitance in reading 
comprehension and writing skills, the STEPS students had 66.11 of 
their group earning -balow marginal" scores at the beginning of 
the school year. On the same taik, the more advantaged students 
In the control classes included 73.9% who achieved scores which 
were "marginal or better," 

The fourth writing task was administered at the end of the 
academic year, in June, 1984. On this task, there were no 
significant differences between the STEPS and control students. 
In fact, the STEPS group had a slightly {but nonsignificantly) 
higher percentag^a of students scoring at "marginal or better" and 
"competent or better" levels on task 4, as shown in Table 3, 
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TABLE 3 



Compariion of Wrltinf AsBeasment Scores for Eighth-GradB 
Classes and Control Class.B ^Ith 1973 anf li?! NAfiP Sfta lor' 
National SampleB of l3-Year-01dB 


Assessment 


Not Rate 
able 


Below 
MarQinal 


Marginal Competent 
or Better or Better 


Scores 

' «— ^- _ _ 


<0) 


(1) 


<2,3, 44) (3 & 4) 


Source 
Date 


Tftsk If 


Letter to the Principal en TV Vietering 
Policyi Septfimber, 1983 


STSPS Classes 
Cn - 59) 


0 


66. H 


j3.9% 6.8% 


Control Classes 
(n ■ 46) 


0 


26.1% 


73.9% 32.6% 


Source 
Date 


Task 4i 


Letter to House 
tion for Class 


Leaders on Recommenda- 
Tripi June, 1984 


STSPS Classes 
in • 58) 


0 


33.3% 


66.7% 28.1% 


Control Classes 
(n - 40) 


0 


37.5% 


62.5% 22.5% 


Source 
Date 


NAEPi 


Letter to Principal Recommending Change 
for School Improvement 1 1973, 1978 


National Sample 
(n m 2,552) 
1973 


2.9% 


28.0% 


69.1% 28.41 


National Sample 
(n • 2,793) 
1978 


2.3% 


33.6% 


64.0% 20.3% 
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Thlfl reault should not be Intorproted that the STEPS group 
outpor formed the more advantaged control atudonte, or that the 
control group'L parforitiance diminished over the couree of the 
school year. Comparing porforinance on similar but nontheleas 
different writing tasks (1 versus 4) ia tenuous at best, a more 
defenelble interpretation is that the STEPS group benefitted from 
their instruction for thinking and exprossing oneself clearly in 
writing. The -traatmente- received by the control students in 
their Englioh classes and foreign language clasBea were not 
deslgnad expreasly to Improve writing skills, it is also 
Important to note that the STEPS students received the writing 
tasks as part of their course and knew that their scores would 
contribute to their gradesi the control students did not have 
similar motivation to perform well. The student interviews 
described In the next section were used to probe about the 
influence of prior knowledge, interest, instruction, and 
situational factors on the students performance in writing. 
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This ...lu.Uon sou,H. .o a.t.^ine not only whath.. the 

STEPS curriculum could halp students writa „ore clearly „d 

effactivoly but also why and how STEPS mi.u^ u 

STEPS might be accomplishing this 

goal. It wai decided to interview studen*-. = 

wBiviow studenta soon after their 

experience with a writinn 

writing activity, interviow schedules were 

designed to inquire about the i , 

**** student's knowledge and interest in 

the topic, and about the thlnklna stratcoieE ^4^. ^ ■ 

-uj swratogieg atuden-cs use in 

ai«e..„t wrUin, process interview, were aeveiopea, v,i.H „o,t o. 

4^ **Ming writing aeaignjtient. 

in t.e «r.t end fourth writing proc... int.rvi edition,! 

9.nerai ,ue.tions were «Hea .bout whet f.ctors end l.ernin, 

experiences help students to ur-i*. 

Tiuoente to write more easily. The four writing 

process interview schedules ere given in Appendix C. 

AS Shown in Table 1, the evaluation design called for 

thinking/writing process interu.*^^. - 

y R ocess interviews m conjunction with each of 

the four writing tasks for the STFft« ^i 

tor the STEPS classes. Four students in 

-ch Of the four STEPS Classes were .ando.ly selected for 
participation in the interviews, each student was interviewed four 

times over the course of the school year of #h 

sunooA year, of the 16 students, two 

were transferred, leaving 14 SXIPS gt«rfe«#, . ■ 

g i« students with complete sets of 
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♦ riting samples and process intfervifews* Four students in each of 
the two control Glassaa ware also randomly selected for 
partiaipation In thm procose interviews* Since only two writing 
eafnplas could be administered in tho control classes, only two 
process interviews {first and fourth) were used with the control 
students* 

The avaluator compiled a case study of materials for each 
student selected for participation in the process interviews* 
For STEPS students, a set of data Included four papers and four 
interviews I for control subjects, a set contained two papers and 
two interviews. The information wae condensed to two pages of 
notes for each student* The notes were used to check if there 
were pattarna of factors that made writing easier, more fluent, 
more effective* Students* expression of interest and prior 
knowledge in the topics were also noted in relation to scores on 
their papers. Special attention was given to the students account 
of how he or she approached the assignment, what pre-writing 
activities the student employed, what classroom activities may 
have helped the student with the assignment, and what the student 
thought of his or her finished product* The evaluator returned to 
the original interview forms to check whether these responses 
differed by topic, over time, among individuals^ and between 
groups* The analysis was a qualitative process of sifting through 
the data, discerning patterns, and checking those trends against 
alternate hypotheses to determine which were best supported by the 
responses. 
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Ono overriding impression about the writing procaas 
interviaws i« that students' accounts of what they wrote in the 
letters or aieays n,atched almost verbatim what they flctually wrote 
on those aeeigmnants. (The Interveiwere had been trained to take 
verbatim re.ponses to all interview questions whenever poaaible.) 
Thus it seemed that asking students about a writing asoignment one 
or two daye after the assignment was completed might be an 
accurate way to find out about the thinking strategies and 
activities employed in the writing process. 
General Questions 

The first and fourth interviews asked students to locate 
writing as a difficult or easy task among the range of subjects 
and types of assignments they had to do in school. In both the 
STEPS classes and the control classes, there were students who 
named writing easiest and most difficult, but most placed it in 
between. Without prompting, many of the students would qualify 
how easy or difficult writing comes to them, "it depends on the 
assignment." These interviews also inquired directly about what 
makes writing easier for the students, including characteristics 
of the assignment, where and when it is done, and what resources 
are helpful. Without exception the students noted that familiar, 
interesting topics are easiest to write about. About as many 
would like a choice of topic as would have a topic assigned, as 
long as its interesting. 
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Individual preferences were also reflected in the range of 
answQrs to whero they would like to work on an aesigninent and how 
much time they needed. What seemed to be behind the responses for 
both STEPS and control students were the concerns about where they 
could get help getting started, from the teacher or a parent, 
and/or where they could concentrate. If only one clasi period was 
allowed for an assignment, students wanted to take it home if it 
was at all difficult. A few very blase students (with 
consistently low writing scores) didn't seem to care what 
conditions prevailed. 

In the first process interview, the students in both groups 
seemed tentative in their reBponses to questions about whether 
certain activities and resources make writing easier, like 
discussing ideas, looking up information, gathering data, working 
by oneself, or looking at other writing samples. Unlike the 
spontaneous and immediate responses about interesting, familiar 
topics being easier to write about, it seemed that studants were 
thinking about the helpfulness of the aids to writing for the 
first time— testing the interviewer's prompts against their 
writing experiences, and qualifying answers according to the topic 
of the writing assignment. 
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In the fourth process interviewi the STEPS students seemed 
to be surer of their answers to theaa general questions about aids 
to writingi backing up their choices with examples and unprontpted 
commentary. In general, individual control atudente reported the 
same preferenaes as before, but noting that they did not have much 
writing experience during the year. 

The general queitions on ease of writing and facilitators to 
writing were used only in the first and fourth interviewe, With 
this axcaption, all four inteswiews had parallel structures with 
sets of questions on the following issues i interest in and 
knowledge of the topic; relation of classroom instruction to the 
writing assignment (particularly in Intervlewg two and three, 
relating to movie ratings and videogames) i and the individual 
thinking, planning, and writing and editing procesfies the student 
used to complete the assignment. 
Interest and Knowledge of Topic 

Students* responses indicated that their interest in the 
topic and the prior knowledge they bring to the assignment have a 
great deal to do with their subjective sense of ease in writing* 
It also appears that these factors have a great deal to do with 
characteristics of the papers they produce, including fluency and 
coherence. The fourth writing task, to write a letter to the 
house leaders making a recommendation on the class trip for year's 
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eighth grader, produced the most fluent and animated writing of 
any of the assigned topics. It was clear from the interviews that 
their rocent experience on the class trip to New York City and 
Washington, D.C. was a vivid memory and for moat of them a very 
pesltlvo one. Several students in both the STEPS and control 
groups commented that they liked being asked for their opinions 
and liked doing the assignmenti most of the students were pleased 
with their finished papers. 

The STEPS students, who could compare the "trip letter" with 
the es%ay on videogames, uniformly noted that the letter was 
easier to write because they could rely on their own experience 
and "had just lived it." The videogames essay required collecting 
new information-others' opinlons-and making comparieuns before 
they could proceed with the assignment. Several of the students 
expressed having little or no experience with videogames and just 
as little Interest. However one STIPS student who did very 
poorly, scoring all "I's" on the other three writing assignments 
did well (a "3") on the videogames essay, probably owing to his 
superior knowledge of the topic. He claimed no further Interest 
in videogames? they were "passe," but he had been spending up to 
20 hours and $50. per week in a local arcade. His paper read as 
though he knew what he was talking about. 

The previous assignments on watching television on week 
nights and on the merits of tha movie rating system were mildly 
interesting to the students, but few expressed strong interest or 
lack of interest in the topics. There was a great deal of 



3o 



- 29 - 

sameness to the positions voiced on the T.V. policy? "T.V. has 
some value, but got your homework done first." The control 
BtudentB were simply more articulate in expreaaing this position 
in the first writing assignment. The essay on movie ratings, 
given only to the STEPS group, seemed to lend itself to more 
issues for discussion. On this topic the interest and prior 
knowledge were more variable. In all, the topic of videogames was 
least interesting to the students and the class trip most 
interesting. 

Connection of Instruction to Assignment 

Th© second, third, and fourth writing process interviews 
included sets of questions asking students directly whether their 
classroom instruction affected how they proceeded with the 
assignemnts. As should be eKpected, all of the control students 
reported that they saw no link between instruction in their 
English classes and the letter writing assignment on the class 
trip (task 4) . However, one noted that reading literature helped 
her to take another's point of view, which was helpful for the 
assignment, and another felt that her experience in writing over 
the course of the year was probably useful. 

Almost all of the STIPS students named several classroom 
experiences which were helpful for doing the writing assignments i 
taking notes? discussing ideas,* "especially the planning;" doing a 
rough draft,* and, for the videogames essay, "the computer 
results," These claims were elaborated in responses to the next 

38 

ERIC 



- 30 - 

set of questiDns on how they approached the assignment r but the 
questions relating olasaroom ©KperienQes to the writing 
aasignmentE w©re askad directly at first, to find out where any 
help might be coming from--STEPS or some other school experience. 

The only instructional aid mentioned which was obviously not 
part of the STEPS curriculum was •*the triangle," It was eKplained 
to the avaluator that language arts teachers throughout the junior 
high school use the figure to help students think about a writing 
assigmnent from three different perepectives'-^the writer, the 
audierfae, and the content itself. It appeared that soma STEPS 
students used the approach to advantage in the first writing 
task, but difficulties arose in later assignments when other 
planning techniques were introdueed in the STEPS curriculum. 
Thinking in terms of triangles while creating lists of pros and 
cons or following guidelines for data collection and 
interpretation produced some dissonance for at least some of the 
STEPS students. Apparently the students did not feel free to 
vary their approaches to planning and pr^-writing. 

It was clear from students' responses from that elasfaroom 
discussion had an influence on the direction, fluency and clarity 
of their writing. Most often that influence was positive. 
However, there may have been some detrimental effects. For 
example, there were a disproportionate nun4)er of students in one 
class who missed the point of the first assigmnent. As noted in 
Appendix B, they were supposed to advise the principal what policy 

If 
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to rocommend on studento' watching television on week nights. 
Instead, they argued who should make that policy, the school or 
the family. It is moat likely that the olassrooin diacuoBion lead 
them off the track of the original assignment, even though the 
task was given to the etudenta in writing. 
Exparience in the Writiner Procesa 

In all four seta of interviewa, students were asked how they 
first reacted to each writing assignment, how they got started, 
what were the subsequent steps, whether this process was what the 
student normally did, whether the student "got stuck" at all, what 
kind of editing the student tried to accomplish, and whether the 
student was pleased with the finished product. This 
"metacognitive" ability to think about thinking and discuss the 
experience of writing was the "common denominator" in the last set 
of questions on the interviews. 

To the extent one can be sure with such cumbersome 
qualitative data, it seems clear that this metacognitive ability 
to reflect on the proeesses of thinking and writing is closely 
related to performance on the writing tasks. Interviews of 
control students who scored "competent or better," (3 or 4), 
revealed confident, articulate responses about how they approached 
the writing assignment and what they were trying to accomplish. 
It should be noted too that interest and prior knowledge of the 
topic were also satisfied in these cases. 
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The overriding impression from tho interviews of STEPS 
studenta, after the importance of interest and familiarity with 
the topic, was the increase in their ability to reflect and 
conwnant on what thay were doing as they progressed through each 
assignment and what they were trying to accomplish, eepecially by 
the third and fourth interviews, it was evident that the planning 
and prewriting aotlvities were critical components of the gain for 
these students* 

some other STEPS students who were not so successful in 
improving their writing performance, ts scored by the primary 
trait 'scoring method, nevertheless became more fluent in their 
writing. They had more to say, but they missed the main point of 
the task. These students also had more to say in the later 
interviews about the processes they used, but they seemed to be 
reciting newly familiar, but not thoroughly understood strategies. 
AS noted in the previous section, some of the students tried to 
apply -the triangle" to whatever writing they did, even if new 
planning strategies interfered with the old tool. 

Most of the students in both the STEPS and the control 
groups were clear about what they were trying to accomplish with 
each piece of writing, even from the start of the school year. 
The only qualification should be placed on the videogames exercise 
which required a series of subtasks and was perceived as a 
contrived project by some of the students. 
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Another consistent finding was that students in both 

eKperimental and control groups did very little editinf beyond 
correction of punctuation and other mechanical errors. Only a 
few spoke of moving paragraphs around or changing the order of 
ideas and arguments. This finding persisted throughout the school 
year for both groups, it would be important for teachers to note 
whether this was a constraint imposed by limited class time, 
limited writing time, limited readiness of the student, limited 

opportunity for the teachers to review so much writing and offor 
feedb^k— or whether students were not taught to think of editing 

their writing in more than superficial ways, 

Fi:'.ally, most of the students most off the time reported 

that they were pleased with the way their writing had turned out. 

Very few students criticizad their final papers to their 

interviewer. 
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COURSE EVAtUATION INTERVIEWS 

The writing procesa Inttrvl.ws, whoee raeults ware dlacuaaed 
in the previous .ection, had been designed to proba into the day- 
to-day t.aehing and Itarning activitl^. which influenced students' 
perfomtanee on th« writinf taski. In a lanse, tha proceis 

- ^ aan„a micro leval quifstions, as a coinpl«m#nt to 
thmud intttmewi, fnore global, "macro" lav«l queitions werft 
uaed in .nd-of-couirs. Intarviawe to find out how students 
evaluatad their broader learning with the STEPS curriculum. The 
•nd-of-courst interviews had provided vary h.lpful Insightf in 
previous STEPS evaluation., it wa. decided to continue the same 
general forinat, because it had been so ■ucessful and because it 
might enable .ome limited comparative analysis between current and 
previous STEPS clasies. 

Two students were randomly selected from each o£ the four 
experimental STEPS to participate in the end-of-course interviews. 
Students who had participated in the writing process interviews 
were excluded from consideration because they had already devoted 
considerable class time to being interviewed and bttcause we wanted 
responses that did not presume the interviewer's knolwedge of 
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previous Inforfnation. Tht^ f<„,i 

, „ ^^"^^ ^^""^ evaluation interview w.. 

indlvldyaiiy admlni«tfir.d to 16 step. . 

to 16 STEPS studentfl. No effort 

rr-^^- --'-^ — — — „; _ 

Findings from the end-of-oouree Inf 4 
^ interviews are reported in 

the following Actions eorrasDondi v. 

in the Interview., th. MdrasEed 

-nwrviewa. the perceived purposes of the courge, 
.n>ph«e., aelf ev,lu„lo„ of hen.-it^ d« ■ . " 
^«tu^. Of the STEPS or " °" -"iculu., 

Of the currieulum. u^iure use 

Pgrceived ^..p.„ , , 

^ - ^^^^ currloulum was adopted ae the 

.n the junior high eehool providing the U.^. .ite. 
students did not identify th. "steps- currieui 

instead ^"^^i^^iun' u^^der that name; 

instead, they called the rm«,^A4 i 

Wrltin9 WorJt.hop." The que.tions In n,. 

.„ „ , ' e.tione in the i.etion of the interview 

on perceived purpose of n,. ' 'view 

<J"l9ned toln,uire What 

the students saw as the purposes of th. 

and how s ^"^^ "tiviti.s 

how .uoh was on readin. io,. and other „on-s,KPS activities. 
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The otudenta offered a variety of reaponsos rogarding the 
purpose of the course, but almost oil were conaietent with the 
objective for STEPS expressod by the curriculum davelopors. 
Students saw the course as one which was BuppoBed to help them 
with writing, problem solving, reading, analogleB, and mystery 
problemfl, in reaponso to the next question asking the students to 
enplaln how they would describe the coureo to a friend, the 
students elaborated on their reiponsea to the previous question. 
A few saw the course as "an eaaior Bnglish class," or a course to 
help you with English elaas,''becauie here they teach you how to 
write and in English they assume you know how." Almost all of the 
fitudentf injected personal evaluations of the course when they 
responded to the description for a friend. 



It's not like other courses. It»a a lot different. 
There aren't as many testa. She helps us out a lot. 
We do a lot of writing, 75 pages per week, but it's 
not that much. 



It's easy but not a pushover. It's easier thtn a 
foreign language. It helps with writing skills. It 
easier because you do a lot of things together. 

You do writing assignments, read plays, do logs. Some 
days it's just boring. Other days she works us really 
hard. 
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I liked it. It's intoresfeing. Toachca you a lot. 

It 'a hord, a lot of writing, thinking about what 
you're writing. Vou can't juat write it out, you n,ust 
usa a rough draft and planning to got into the story. 

It's a course to develop your skills in English, it's 
interestinf, but not that interesting. 

You do trick problems, read 75 pages each week, than 
do a log. You do writing assignments every three 
w«ks. It's stupid that you ne.d to do that triangle 
for writing, it never helps. 

It's very helpful, it really is. If you have 
problems in reading , writing, or problem solving, it 
helps. In other courses too. 

Almost all of the students said that their teachers 
described the course to them at the beginning of the year. A few 
couldn't remember. Almost half of the respondents offered that 
the teacher continued to remind them of the purposes of the cou.se 
and particular activities as they went along. 
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Relative Em phasea on Reading, Mrlt inei and Thinking 

It was Important to STEPS developers to find out how the new 
eurriculum would be fitted into the school's program. They wanted 
to know at an operational level how the teachoro fit the STEPS and 
non-STEPS pieces together since it had been agreed that the STEPS 
curriculum would be only two-thirds of the new course. The STEPS 
developers also wanted to know if the students were able to see 
connections between the various components of the course. The 
line of quoationing was important as a way of monitoring just what 
was the nature of tho treatment which the students actually 
received. (This information was eapeclally needed because the 
classroom observations as envisioned in the evaluation design 
could not be completed.) 

It was discovered in the first few interviews that students 
had difficulty assigning percentages to gauge the time spent on 
different activitiesi their figures did not approximate 100%, or 
they simply couldn't respond. Instead, the interviewer asked 
students to rank order the emphases on reading, writing, thinking, 
or any other activity. With very few exceptions, students rated 
reading as the most frequent activity in the course and writing a 
close second. One of the students who noted greatest emphasis on 
writing explained that the reading they did for the course was 
completed as homework, not during class time. Thinking, planning, 
and problem solving activites were combined in a category which 
received third most emphasis in the students' estimation. 
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Tho students „„e .afc.d to lUuat«te th. «tegcri.s o£ 
.otivia.s-«.dl„9, „.iti„3, a„d thinWng-„uh specific 
«xa„pi... reading .ctivito., the student. na„ed reading 

books amd plays alouH t*ft«^4 i 

ys aloud, .«ading «t home, and answering guaetions on 
worksheets. For wr^4-4«« 

For writing, they Usted writing toeke and othar 

STEPS writing assignnients as wall as »Ar,inr, 

«s doing our reading logs" 

(summarising their reading from the nioht 

■ ''ifht beforfl or the previous 

week). All references to specific thi^x^ir, . . 

fepeeitic thinking activities given by 

the students could *-«/^^««4, j 

wwuAQ oe recognised as STEPS nmhTf^mf, i 

profiicma, exercises, and 

activities. Whan asked if there v.«re connections made between 

these areas in the course, one student .«lrt *k 

, one stuaent said the connection between 
reading and writing should be oho<oi,c a 

- obvious, and one couldn't understand 
the question despite sev^T-ai ^^^u ...j 

Pite several rephrasings. However, almost all the 

^tudents felt there were very fa. connection. „.de between the 
reading, writing, and thinking components of the course. Reading 
and problem solving were connected, as .e.e the planning and 
writing activities on specific a.aingment.. But there were no 
connections between the two major .ompc„,nts of the course, 
reading and writing. 

Finally in this group of qu^^tio^s, the students were asked 
to describe a typical class period. There Was striking uniformity 
- their response, to this question. Virtually .u .^e students 
mentioned the.r reading logs es the activity which took up the 
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first 10 to 15 mlnutQS of each class, i.e., writing suimnaries of 
what they had read at home since the previous claas. It was 
apparent from their explanations that what followed depended 
largely on what unit they were doing in the STEPS curriculum. 

"It's all premeditated. Come into class. Work on 
reading logs. Start working on a writing assignment 
or preparo for a test. We do group work on opinion 
topics (preparing for writing), it varies a lot." 

"We'd start off Tuesday and Thursday doing reading 
logs. Then, depending on what we're into — writing 
or problem solving — would be the rest." 

"Grab your reading log. Write what you read or when 
you plan to finish (75 pages per week). Then we have 
writing assignmants which we discuss with friends. 1 
it's due and your 're on your rough draft, the teacher 
gives you a lot of choices, you can take it home or 
work after school. 



"We'd write a log, then we'd find out about the rest 
of the day. Usually we'd have a discussion before 
writing a story, like with drunk driving." 
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Self Eval uation of Benefits from th e Curriculum 
improvement in Reading and Writing 

In the next set of queBtlons, the students were askod 
whethor the Reading/Writing Workshop (the title by which they know 
the course) had helpad them in reading, writing, thinking or 
problem solving, and if so, how. A few mentioned "careful 
reading," and "looking for clues," but most cited improvements in 
writing. Thair responses were sure and detailed. 

"Writingj. Tha process of discussion helps. Vou get 
hold of a subject before your going to write so you 
know well what to say. You have soraathing to say 
instead of aimlessly going into a topic and not get 
anything out of it except a grade." 

"It helped my writing in English and in science. It 
gives you ways to study and outline. With writing 
assignments, we learned how to plan out the main idea 
of the story," 

"It helps me write better. I understand more what I'm 
writing. The problem solvings help me plan out what 
I'm doing better," 
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"I can understand what wa're writing and how to go 
about it, Th® course gave mo the notion of 
audience. " 



Trans far Va lu e o f Co u r a e Ou t eonie s 

Fully three-quarters of the students Interviewed for course 
evaluations claimed that the Reading/Writing Workshop helped them 
learn better in other areas of the school program. Almost all of 
these students named help for their English classeB, and several 
mention help for science and for social studios. Some cited 
specific skills such as writing, note taking, putting ^.hinga into 
categories, and organizing ideas, others named specific 
attsigmnents or topics within other courses.* the Romeo and Juliet 
assignment in English; the El Salvador /Central America debate in 
Social Studies (to debate ^•faased on sound facts")! social studies 
journalsi the assignment on Russia. 

Only four students responded neeratlvely to the question 
about the transfer value of the course. One could only note that 
books read for the Reading/Writing Workshop course counted for 
English too. Another explained that "You don't do problems like 
that in other courses." Both of these students contradicted these 
responses in the next set of questions on affective outcome of the 
curriculum when they noted the course made writing assignments 
easier and helped with "thinking up ideas, pre-writing, and 
planning." it may be that these two students did not understand 
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the concapt of transfer value. The remaining two students who aay 
there was no benefit to other aroaa in or out of school wore 
students whose entire interview response ware very negative about 
school in general. 

A ffective Outcomea of the Course . 

It has always been important to the STEPS developers to 
aeaess the affective outcomes of the STEPS curriculum, indeed, 
the promotion of a positive attitude toward learning and the 
development of a positive eelf^ooncept are major underpinnings of 
the Waters curriculum. The set of questions on affective outcomea 
inquired about improvements in the etudenta' confidence in their 
academic abilities, motivation, stamina for more difficult 
assignments, and lnd«p«ndenoe in learning, as well as decreased 
fear of writing and reduced stress in the process of writing. 
Even students who claimed there were no positive benefits from the 
curriculum in the previous sections responded positively with 
extended responses to the questions on affective outcomes. One 
such student respondedi 

"Before I'd never make a plan first before writing. 
Now I do.... Oh, yeahl On problems, I'd try really 
hard to do them, then ask (but not give up) . 
(Regarding ease of writing) the plan makes it easier, 
if I have a good topic, 1 can do it. We've had good 
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topics all year except videogame!}. .. .yeah, I'm morr 
independent now, in other classes too." 

As noted in the prfiviouB aeetion, 75% of the interview 
respondents had evaluated the eourse as one that helped them with 
the cognitive skills in reading, writing, and problem solving. 
All of these etudents also noted affective benefits from the 
course but they were careful not to make sweeping claims for the 
course. Their answers ware tempered, qualified, and usually 
focusM on performance in writing, as illustrated by the following 
responses . 



"1 know 1 can write better and it's a lot 

easier Yes, if there's something hard I'll try it. 

If 1 mess up, it's OK. {Regarding becoming more 
independent as a learner) Yes, The teacher helps you 
but she doesn't give you the answer. You really have 
to think about what you want to say." 

"Yes. When I got stuck before, 1 didn't know what to 
do. Now I know how to look back and see the facts. 
(I'll try more difficult assignments) but it depends 

on the topic, some are boring Once I get started, 

I can stay with it. (I'm more independent) in some 
ways, but 1 still need help with problem solving. 



erJc 
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"Now I don't got frustrated with writing. The course 
make it easier to write on a subject you don't really 
want to do. YOU look at it and think of good ideas to 
write. (It's made me more independent) because 
usually you want the teacher to tell you the answer. 
She won't tell you but says 'go back to page 10 and 
find the answer.' she will toll you if you really 
can't get it yourself." 

Teaehlfiq style with STEPS 

Students were asked if the STEPS course was taught 
differently from the other courses they take. All but one of the 
respondents indicated that there was a difference. Asked to 
say what that difference was, two students who could not explain 
the nature of the difference but insisted that the course was 
taught differently. Most of the students' answers portrayed a 
supportive, relaxed atmosphere in which the teacher provides a 
great deal of individual and group assistance as well as several 
options for completing assignments. 

"It's nothing like She gives us help; makes it 

easier. She helps us make lists of things to put in 
writing assignments. She helps us plan it." 
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"in ^ost have to ba qui«. Thia ono Is 

more relaKed. " 

"This one's = lot dl«„ent. Most of the tlmo other 
teschers Just give directions and teU us to ,o to it 
She (STEPS tescher) win take a whole period to 
-plain a writing assignment, she gives us .ore ti.e 
to write and explains more." 

-The teacher can always co,„e around and help us 
individuals, in .ome other courses if you raise your 
hand, the teacher tell, you to put it down, i 
this because if i need help she can =on,e right to .e 
The course needs teachers wil abilities in how to help 
students solve problems." 

"in this class you get more time to taU. i„ other 
courses you can't . Also, in other courses you don't 
9et Choices. Here you can be flexible. Vou have the 
freedom to chose where and when you win finish the 



"Ves, definitely. There's more independent work. The 
teacher will come around if you need help but she 
doesn't stand at the chalk board the way th.y do in 
-St classes. „e work a lot in class, so there's not 
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much homework, l like loarning independently. The 
teachar is there to help, in other classes and at 
home there's no help from a person who knowo." 

The teacher's ability to be patient and explain in detail 
wore characteristicB most frequently cited by the students as 
important ones for a teacher of the STEPS courae. 

"He doesn't rush the classes. He explains in detail 
and helps individuals." 

"The teacher has to have a lot of patience. The 
people she talks to are having problems. In other 
courses the teachers don't worry about students' 
questions. " 

It had been the evaluator's plan to inquire if the etudents felt 
their STlPS teachers used the same or different approaches in 
other classes they taught. However, none of the students in the 
interview sample had their STEPS teachers in other courses as 
well. 
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Studtnt IntJXactlons _ in BTC PS Clauum m 

Th® count evaluation interview included a sariea of 
qu«8tlon» Which were designod to inquire if students woro usinq 
each other ag r*tourcfia for learning, and not juit relying on the 
teacher for infonnation, aa th«y would in a traditional clafisroom 
environmBnt. Previous evaluation. o£ the STEPS curriculum in both 
traditional and alternative Bchools had ahov/n that the STEPS 
curriculum proinotftd vsry positive studant-to-ttudent interactions 
In thfl views Of the STEPS student.. That ttfect was con.iderably 
aimlnighed in the 1983-84 STEPS cloti.s. 

Moat of the atudenta said that the way atudenta treated each 
ether in the STEPS Reading/Writing Workshop classee was no 
different from th« way students responded to each other in other 
elaiaea. only a handfrl of atudtnta did think thera wa« a 
difference which each characterized in the responseB given below. 

"Vou can talk to other kids while you're working. 
It's good to hear what other kids have to say. it 
helps to hear how others figure out problems. That 
doesn't happen in most the the courses I take." 

"There are cliques in the sohool, in this claisa they 
mix." 
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"Yeah, Hide help eaeh other a lot in this clnns. Some 
things are laasicr for some kids and they'll help, m 
other courass kidn keep to thGmielves . " 

•'Yes, everyona's firiondly. The ttaehdr won't tolerate 
picking oji someona. We don't make fun of students for 
making fnistakos. We all make miatakes. Also, you can 
pick up certain things from the BtudentB." 

A varitity of ciofts orranfments were used for InBtruction in 
tho STEPS Ql&BBBB, and altnost all of the atudenta commflnted that 
they chiinged deponding on what asaignmtnta they were working on at 
the tiine. The roost proval»nt arrangeinent appaared to be 
individual work— on essayi, reports, and reading assignments. The 
next rnost frequently used arrangament waa full class diacussion 
(usually in preparation for a writing aisignemnt) or reading a 
play aloud (an activity which was not part of the STEPS 
curriculum). The students did work in pairs, but only 
infrequently, and then on puzzles or worksheets. Small group 
arrangments of three or more were almost never used, but the class 
sizes were sniall. 

While soma of the students described a different kind of 
student interaction pattern in STEPS elaases as compared to their 
other courses, the majority of students described the STEPS 
classroom in terms of teacher-dominated classes discussions and 
individual work. Data collection as prescribed by the original 
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©Vflluatlon design would have enabled more thorough and objective 
investigation of the classiroDni interaction patterns which took 
place in STEPS class©® » However, the STUDENTS obisorvation 
schedule which is shown in Appendix E was not administered as 
planned* The evaluation assistants met resistance from the 
teachers ovar tha heavy demands on class time which th@ evaluation 
design saamed to require. Even though the observation instrument 
should not have diverted considerable class time to its umm, 
especially aftar the students and teachers were accustomed to the 
presence of the observer in the classroom^ the evaluator and STEPS 
develops agreed that it was more important to secure teachers* 
commitment to the collection of writing samples and the conduct of 
the writing process interviews. 

Initial efforts were made to use the STUDENTS observation 
system with STEPS classes. The few trials which were completed 
reflected the pattern described by students in the course 
evaluation interviews. One sample shown in AppendiK E illustrates 
a class in which the teacher was orienting students in full class 
diiscussion to prepare for individual work which occupied the 
second half of the class period. Another sample reflects a 
pattern of individual work followed by full class review* 
However^ it would not be appropriate to characterise the nature of 
instruction in STEPS classes with such limited observation. The 
data is included only for the purpose of illustrating what the 
observation schedule might reveal if it were used over an extended 
period of time. 



0 
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Students' Recominendatl ona for Coureg Improvemant 

In the final set of quoBtlons on the course evaluation 
intorviow, students wore auk 1 if they would make recommondationa 
regarding the size of the class, the content and relative emphasis 
given to each area or skill, and the number of class meetings each 
week. Regarding clasB size, almost all of the respondents were 
satisfied with the class size they experienced with the course. 
One atudent whose entire interview had a decidedly negative tone, 
■aids, -No, he'll maybe get to you once." But anothar student in 
the Bame class felt the size was small enough to get personal 
attention from the teacher. "He always has time for kids. It 
gives you more confidencB knowing someone is there." These two 
atudents had been selected at random from the largest class 
Cn»lS) . Not only did the majority think that their classes were 
small enough, most felt that getting personal attfintion from the 
teacher was important, particularly for writing assignments. 

The students' most and least preferred activities in the 
course varied considerably. They mentioned specific problems, 
puzzles and analogies in no particular pattern, since Unit Vll of 
the STEPS curriculum included a course evaluation form addressing 
some of the same questions, the individual responses are not 
tallied here. (See Appendix F.) However, two major themes were 
apparent. There were several intense criticiims of the reading 
logs as part of the course. 
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"I hated the reading logs. Get rid of tho rt^ading 
logo. MoBt of the kids just road tho back of the book 
anyway. The teacher never quizzes us on the books." 

Another simply emphasized.. "The reading logs have to fo. I " Only 
ona student mentioned the reading logs as an flctivity sh« liked. 
"It's not too much to read 75 pages a week." 

The other major th«me which was apparent in the students' 
unprompted rftoommondations for changes was the choloe of topics 
for the writing assignments. Several noted that it is important 
to chooMe interesting topics and made apeclfic referenco to the 
Videogames assigmnent as uninteresting and/or unimportant. 

Regarding the relative emphasis on various areas covered by 
the course, most felt tha distribution was "ok." There ware four 
requests for more time on writing, one for more time on problem 
solving, and three for less time on reading. As to the frequency 
of class meetings, all but two felt that meeting three times per 
week was "good the way it is.« one student who did not want to 
take the course at all would have lowered the frequency to two 
meetings per week. The other student liked the course very much 
and wanted the class to meet five times a week. 

m general, the students were agreeable to being interviewed 
and thoughtful in their responses. Host were consistent in their 
responses, but a few were not. The interview schedule included 
several cross checks and opportunities to verify or expand on 
students responses, so most inconsistencies could be clarified. 
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INTERVIEWS AND CONFERENCES WITH TEACHERS 

^zmB were usod to gather the teachers' 

v„lety of issues related to STEPS davelopn,ont, 

impiementatlon and ev^iiiii*.4«« 

evaluation. These opportunities included. 

semi-structured interviews with th« . 

With the evaluatori notes from staff 

ntMtings, informal conversations at tha field ni, . 

is «c cne iiald aitoj and extended 

Informal discussions at a natlot^fli 

a national conference attended by the 

STEPS .taachers, developerB and evaluator. 

.ha STBPS developere were devotin, „a,or attention durin, 
he Saa^S. academic year to rewriting and editin. the st.ps 
teachers .anual with the view toward pu.U.Hin, and marketing the 
-e^a.. in ways that would he attractive and u.eful to .chool. 

For financial and ora^*-4^ai *. 

ana practical reasons as we3 1 ^ 

^«J-J-» the implementation of 
the STEPS curriculum during the 1983 . - • 

' 1983-84 academic year was limited 
to one fiel, offering four classes taught ,.o STEPS 

teachers. No one in the system had used the steps curriculum 
before. 

Th. t..cher, Who agreed to try th, eurrieulum ware 
experienced la„,u,,e arts teachers who were positively ratea .y 
-eir principal and other colleagues, xhey were -ris. ta.ers" as 
-own .y .heir wini„,„ess to try the ST„S curric.lu.. .hey were 
»lBO .otivatea to improve what they felt haa heen an i„aae,uate 
-«se for ei,hth-,raae students who were in need of remedial 
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ftssiatance in tha language arts, Th© teachers noted that they 
were int^raited in using the STEPS curriculum but also wanted to 
include reading assigmner.ts and some vocabulary work in the new 
courge too. 

After a year's aKperienca with STEPS, the teachers ramained 
attracted and committed to tha STEPS curriculumi its philosophy, 
goals, and approach to taaching thinking and writing skills. 
However, they ^Kpraisad continuing discomfort with following the 
teacher's manual clos©ly. Both felt that the manual as written 
was too confining and too wordy for experienced teachers. They 
advocated a more streamlined format with better crosa*referencing 
to what student worksheets will be used at various points. 

Both teachers wanted to use some exercises and worksheet and 
exelude ©there. One was particularly eKpressive on this point* 
There were "several good ideas, but the materials weren*t me, I*d 
like to be able to draw on materials I could get excited about, 
that are engaging to me." But he felt that in some of the present 
STEPS exereises, the skills were relevant but the contexts were 
inappropriate or silly for eighth graders. The teachers said they 
appreciated that their eorartents were being heard and they looked 
forward to the opportunity to participate in the revision of 
materials. 

It was apparent to the STEPS teachers and students alike 
that the reading selections for the Reading/Writing Workshop were 
not well coordinated with the STEPS portion of the course. Both 
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teachers wanted to make more careful salections of reading 
materials for the second year of implementation in their school, 
the 1984«85 acadamlc year. 

The teachere law benefits for the students which they 
attributed to the STEPS curriculum but one in particular would 
have liked a "mora formal pretest at the beginninf of the year to 
BBB where the kidi were starting from. The comfort level test is 
OK for the kida, but the teacher i need a more objective 
assessment. " 

The strongest and most pervaeive theme in thm intarvlawa and 
other coversations with teachers was the sense of professionaliEm 
and collegiality which they felt was promoted by their involvement 
in the STEPS curriculum development and implementation. The 
"biggest plusses were teaming with another teacher; having time to 
preview materials and talk about their use with other 
professionals? being encouraged to reflect on how things were 
working I seeing research on curriculum advancements and where 
STEPS fits in; and gaining the confidence of the administrative 
folks*" One teacher very hesitantly and then directly 
acknowledged the financial compensation for the surmner workshops 
as a benefit she appreciated* The other offered that the STEPS 
manager played a very "important and legitimate role, checking in 
periodically to see how we were doing* That was helpful talking 
to her about individual lessons," 
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">"l"«ion Of thla promotion of pro£o-..o„M. . 
«ye« Of tho STEPS te.oh.r= „a» In tho 

""PP"' 'hoy raceivod to attend 
the n^xonal „,eotlng of the A«ooi<,tlon for su . . 

"ciacion lor Suporvislon and 
ricu.u. Oev..op„.„t in .or. CUy. March »S., the 
international Conference on Thinklno h^.^ ^ . 

School «f Thinking hosted by Harvard Graduate 

School Of Education in August, 1984. At the for 
STwp^ . , ' . At tne former meeting, the 

STEPS developers and evaluator participated i 

develoi^n,- - . participated in a symposium on the 

development and evaluation of a thinking akm 

t-^.^u tninKing skills eurriculumi the 

teachers attended « 

atcenaea with support from the w«f^^„ « 

-"^ waters Foundation. The 
iattec meeting was attended oy the two Steps u 

, ^ ®TSPS teachers and several 

Of their colleagues who were alao interested in 1 . 

^ J-nterestea in learning more 

about current programs and research on ir. 

l„ „ "search on improving students' skills 

in higher order thinking. Their particln^^ • 

^ participation was encouraoed and 
supported financially by their , . 

■•■y oy tfteir school administration 
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RECOMMENDATIONS 



These recommendatione froin the 1983-84 ©valuation are beinc 
provided formally in August, 1985. However, it ia important to 
note that much of the information was relayed before the formal 
report could be delivered, and the davelopera have already begun 
to respond to the suggestions. In addition, it should be noted 
that the STEPS development team had come to some of the same 
concluaions from different perspectives and independently of the 
curriculum evaluator. 

The recommendations are grouped according to their primary 
emphaslsi curriculum development, teacher training, or 
dissemination of the STEPS curriculum. Several of the 
recommendations pertain to more than one category. 

On Curriculum Development 

1. Explain more clearly in the teachers' manual the 
purposes of the various exercises in the STEPS 
curriculum, particularly those in Units II and 111. 
Retain only those exercises, puzzles and problems which 
promote a skill central to the purpose of the unit. 
Encourage teachers to select from various options a set 
of exercises which they feel will be appropriate for 
promoting the desired skills with their students. 
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2. Choo.o th. topica 01 writing asaig„„.nt. with ut«.t 
-aro. The interest and prior knowledge which the 

Students bring to a y/ritinr, 

y o 8 writing aasigmnant appear to be the 

-St important variables affecting their performance on 

«ny writing task. No eingle assignment win appeal to 

everyone, and it is sometimes appropriate to challenge 

""dents to research and write about new issues 

However, for poor writers, topic, enabling optimal 

performance should be used frequently. 

3. Hetain writing assignments in the curriculum which se.m 
to have worked well. Former students' papers can be 
used anonymously to illustrate good and poor writing 
The continuity will also enable comparative analysis 
across cohorts of students in the system. 

4. consider using one of the NAEP writing topics as a 
regular part of the STEPS curriculum, so that 
comparisons might be made between the writing 
performance of STEPS students and a national reference 
group. Meaningful comparisons cannot be made 
on different writing assignments. The kaep assignment 
for 13-year olds would be appriopriate for STEPS 
students, "imagine that your principal asked for 
suggestion about how to make things better in your 
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school. Write a letter to your principal telling just 
ONE thing you think ohould be changed, how to bring 
about the change, and how the school will be improved by 



it." 



Use the computer application for data collection and 
file management in the STEPS curriculum only if certain 
conditions are met! the research and writing project is 
clear and cohesive, and the thrust of the oasignment is 
underBtood by the atudentsi the computer equipment is 
accessible to the STEi'S teachers and students when it it 
is needed? a reBOurce person who is experienced in the 
application of the software is available to help the 
STEPS teachers prepare and conduct the computer aeasions 
until the STEPS teachers can act alone; the computer is 
seen as a tool to facilitate the research and writing 
project and not just a diversion from the main purposes 
of the courtie. 



Coordinate instruction in word processing with the 
STEPS curriculum, optimally Unit IV, so that students 
will be able to edit their writing in more than 
superficial ways without the tedium of copying and 
recopying by hand. Word processing is the computer 
application which appears to have great potential for 
enhancement of writing with the STEPS curriculum. 



7. continue the lnvolv™.„t of STEPS teachers In the review 
ana revision o£ the currieulum ^teri.ls. This practice 
pro.otc« the tee=her=. sense of professionalisn,, sense 
Of commitment to tho curriculum, ee well as their 
insightful appraisal of the materials. Their 
porttclpation in curriculum revision is likely to lead 
to more accomplished use of the materials. These 
e:<perienced and committed STEPS teachers can serve as 
master teachers to new STEPS teachers. 

. Alert teachers that some students are not selective 
about prewriting strategies which can be useful with 
various kinds of writing tasks, some of the students 
have tried to apply two or more guidelines for the same 
assignment, and dissonance ensues. Their writing 
appears confused and their oral accounts of what they 
were thinking suggest confusion as well. Teachers 
should emphasize that there are a variety of ways to 
plan and organize idea., and the method should depend on 
the assignment. Reflection on the planning paradigm(s) 
Should be a part of the class discussion in which ideas 
are shared for a particular assignment. Teachers should 
discuss With students how different planning schemes are 
helpful for different writing assignments, e.g., list of 
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school. Write a letter to your principal telling just 
ONE thing you think should be changed, how to bring 
about the change, and how the school will be improved by 
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Use the computer application for data collection and 
file management in the STEPS curriculum only if certain 
conditions are metj the research and writing project is 
clear and cohesive, and the thrufit of the aosignment is 
understood by the students,- the computer equipment is 
accessible to the STEPS teachers and students when it it 
is neededi a resource person who is experienced in the 
application of the software is available to help the 
STEPS teachers prepare and conduct the computer sessions 
until the STEPS teachers can act alone i the computer is 
seen as a tool to facilitate the research and writing 
project and not just a diversion from the main purposes 
of the course. 

Coordinate instruction in word processing with the 
STEPS curriculum, optimally Unit IV, so that students 
will be able to edit their writing in more than 
super flcial ways without the tedium of copying and 
recopylng by hand. Word processing is the computer 
application which appears to have great potential for 
enhancement of writing with the STEPS curriculum. 
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pros and cont;; "th^* »,r < nnr, i ..«. * 

tho triongic for encouraging diff«r«fit 
po.„t« Of vl«w on th. ^^^^^^^ 

the chronology of events. 

9. » tii« student. ^^^^ p^^^^^^ 

t««oh«rs Should be taught to t«ach ...,iu„g ,un. 

With STEM. Student. h«vt ben«£ltt«d fr«« . 

wBijsAAtcea from instruction 

In planning and prewritjng, y,^^ , 

^# wuc tnoir editing of roufh 

drafts h«s been limit«ji al'nn-r . , 

ainio^t exclusively to corroction 

Of meehanlci— spttllint , punctuation 

J, iJunccuation, and capltaliaatlon 

*e..iMe 1, the ..uaent. haa .ccee, to wora prc«.,i„,. 

- The STEPS teachers ahoni^ ^ 

acnera ihould bm made more coniclous o£ the 

toen#fits o£ atudtnt-to-studant 

stuaent interaction* in their 

claigroomt. Previous av^i.t.*.! 

rcevious tvaiuations ot th# Steps 

currclulu. h.v. .how„ th.t rtuaent. 
other .tudentr «-pialn e problem or . .olutlon. i„ 
th«e earlier .tudent interview., it wa. found that 
h.«in, other atudent, think aloud how they .olv.d 
problem, wa. -ry helpful to many .tudent.. v,c ot the 

ob.ervation schedule to monitor what Kind, of 
=l».room interaction pattern, take place would be 
helpful not only for program monitorin, but al.o for 
trainm, teacher, to encourage .tudent participation. 
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On HarkmtiRq j^n ^^ Diai emlnat ion of STEPS 

Hi There i?i 0videfice that th^ STEPS eurriculum Is effective 
for improving studantg' skilXs in ^Kpository writing and 
that it mmmmB to ba plaiced appropriately in a languiige 
arti sequence. However, if other araas are joined to 
the STEPS eurrioulum, th© additions should be niade only 
if th®y arm eonsiitent with th© major thrust of tha 
STEPS cyrriculum, STEPS studente %*mrm ^warm that many 
skills oontributed to writing and problem solving but 
they ware appropriately critical of activities which 
bora no relationship to other parts of the course* 

12* The STEPS developGrE should try to impltrrnent STEPS in 
ichoolg which proniDte staff davalopment, encourage 
collaagiai interaction among teachers and have the 
iupport of a building adrninistrator * If the curriculufn 
is to survive it must find a legitiffiat# place in a 
school's program, gain the support of a team of 
teachers, two or mora, who aa.^ trying to improve 
curriculum and who have the support of their principal* 
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QUESTIONS ADDRESSED BY THE CVALUATOR 
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QUESIIDNS AfiCRESSED SV THE EVAIUA110N 



i^cusef q uest ion 

Rtgardlng itudtot pfrlaraioct and Itirfilng pracisgesj 
1, 2i tht STEPS eurflculm tfltctlvt 1r liprovini 

2* Whit thifikioi ilrctfgits do tht •iudtiti tmpley 
In prtparacioB far writittg, «s wtll «i during 
wltlag i^d riwrlEltig? 

3. t:*t EhlokiDg itr«tt«giti itudinti tmpl©y ehaogt 
ovtf cht eourit el the y«gf ? 



4, VhJt teaching gad Itgrnlog tipifltoeti ia th# 
STEPS cyfrliuius grt tico fey tht ifiudtnts 
«s edAblgri lor improvltsg thlnklsg itratigiti 
Asd l©r witlag? 

S* bov long sust tht iT»S cuwfUulm hm ustd, «nd 
i#llh ifhgt iaitMlty, btlort Isprovtutstt cgs U 
Mttd Is iti^tott* thlsklttg •trgtiglti, vrltlBg 
ptrloroaisMi gad im Ehtlr Mnii4mncm im uodgrtaklng 
vflllQg gggignniQii? 

6. Cots gny ImprevMiBt 1© thleklfig i^rilAfiti gnd/er 
iMrtAit la iifltiag prof lelii§y duf lag 

tht STEPS pMgrg» irgagftr go •tudeais* pttrformgaeg 
gad eaafidiaet ia uedirtgklag gtilgtwtalg 
la oihgf cpurgei? 

Rtggfdlag ggaehtf bthavtorg gad clggaroas lat«rgetl0ati 

7, Mow eloagly do tha STEPS tiaahtra fallow £ha 
currlculua guldai vhgi; gddllloaa, o&laaloaa» or 
o(hgr ehaagta liould thgy rgeoraaad la thg auggaatad 
gctlvltlagj whgt Ig thalr paea ©f laatryetloo? 

S. Whan thay uaa iha STEPS currieulys, do laashara 
adope dlffaraai atylta froa thoaa thiy aspley la 
laaehlag othtr gubjactg? 



5* Mhgi faaehar^to-atudaat aad atudtai-to-'atydaat 
latarg£tloa pattarag tgka plaea la tha STEPS 
elgggaai hoif do thaga dllfar from paiiaraa 
obaarvad la ©thar ^Igiaaa with tha aasa taachara? 



Wrltlfig TaRki and 
Primary Trait Seoflng 



Sludaat lattrvitiii 
©a TOlnkiog and 
Wrltlag frocaaaai 

StyJaBt Zatarvlawi 
m rhlmkliig aad 
Writing Frocaasii 

Stydaat latirvltwi 
for Courat Evgiuatloa 



Wrltlag Seoraa; 
Studtat latarvlawai 
Taac^har Zattrvlai^i 



Stydaat Xatarvlaya 
for Coyraa 
evalyatloa; Taaehar 
Coafaraacaa gad 
latarvlavi 



Taashar logai 
Taaehar Coalaraaeati 
Taaebar latarvlawa. 



Stydaat Tatarvlava 
for Coyraa 

Evalyatloai STUOGHTS 
Obaarvgtloa gygtami 
laaabar Zatarvlaifa 

STUDENT Obaarvatloa 
Syara»i Taaehtr 
latarvltvi 



A (cent. ) 

mSUOHB ADDR£SSED BY IHE EVALUATION 
Regarding ttachinft bthivloris 

Sourcg of Data 



eL..«r-"*^ •"iviu.. ia STEPS aod nen-STEPS 
11. Hew long Buat twchnri uat tht n.y eurriculum 

th. STEPS curriculuB, uodtr yh.t kinds of *^ 



13. 



l«ogu«gt arci atqutaea; how i. tht n«w 

curricula «BBeuHetd to psriots? 



STUOtKfS obitrvatlon 



ftachtr Conftrgncts,' 
Te«ch«r Zoetrvigws 



lnttrvl»w» vlth 

Ltadtrs, 
AdBlniitritorf 



lnttrvltjrf« with 

Uadtfg, Dtpartstot 
^••dart and 

AdslalgtratorB 
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APPENDIX B 

PRIMARY TRAIT SCORING GUIDES 

U T* V. Watchi ng Letter 

2p Mo vine Rating Essay 

3t Vl deogamts Essay 

4» Washlngtsn Trip Latter 
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^^c^/^^ policy 

because. i€ should , . . , 
^ tMi ond i^ccaxjs^ )t /tally doe 

/I snrt each ^lq^^t.^ 

ha mU^ or Ik, don^ becBUSC TV; j 

I 

;^^^! 



FRIG , 75 



-2. 

!^Lf f " might give an «iabew9e diieuMlin af ih. i.sus; k^T^ 
polley .ugt««ted is . par.enai ona, darivtd partially tsm tht arou- 
wnt, tout mt raaily h.Jpful to dtv.ieping a achool-Jida approa"^ 
i«tf K " ^ d«v.lep,di ail ampo^ 

Tlt^i t ajf. in a akatehy, ak.Utal. rudiasantary fer» 

2a no? «Ltfi\; Othar. dl.i.int.d oHha ld«. 

are not ralatad (tha peliey doaa not addraaa tha iiauaa; tha poUcy 
doaa net taka into eonaidaratien value as a aehool-wida poliey) . 

jL''i4;f.,!!f " Pfint o« viaw of tha iaaua dominataa 

tha diaeuaaion of tha Iaaua. giving a akawad pietura of tha iaiue 
avan though all oee^onanta ara preaant. 

^ " f;*!f^*^*'*>!'"* *»? ''^^'"^ ^ P^^^^ ' ^ thaaa papa«, all of tha 
conditlona of tha aaaigninant a^a at laaat BinisaHy mat. Papar* 
daacriba tha iaaua and auggast and dafand a poliey. Raaasning ia 
uaad to ai^and or ai^lain ona of tha two main alananta (tha iaaua 
or tha poliey). for axaapla, thara aight ba a datailad de.eriptien 
or a poaalbla poliey i#tth rfiioni for its accaptanca or an siabefftta 

^ ai^lanation of tha preblas. Oaually ona alasiant ia will davalopad 
While tha othar ia only aaaartad m toataly mantionad) raaulting in 
an unavanly davalopad paper. 

Occaaienally a "3" papar givaa a va^ balancad, wall-doeimant.d 
pietura of tha iaauaa and ispliaa tha auggaatad policy without 
atating it outright. Tha axeallant praaantation of tha iaauaa 
carrita it ovir into the eatagory daaonatrating c«^etence. 

^ ■ jytagiatieally daaerib a tha iaaua and dafand a elaarlv raaaen«d bbII^v. 
Theaa papara would have all tha positiva alananta of "3" 'a with thaaa 
additimai 

- Tha daaeriptien of tha iaaua vid tha policy would elaarlv ba lii^sad 
to aaeh othar. 

- Tha poliey would ba a Isgieal atap froa tha diaeuaaion of tha iaauaa. 

- Both pro'a and eona of taleviaion watching would ba praaantad elaarly 
and aubatMtiatad by illuatrativa axaaplaa, elaar raaaoning, ate. 

- A'ha lattar would auggaat aanaitivity to tha proeaaa of aatabliahine 
aueh a policy. 

- Tha lattar eaata ttia idaaa in a ayatamatic atructura. 
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(b) pQMitim fitateiRent is eontradieted by the evidence, 

(C) Position itatw^anti but no rslated iiupport**©f ten theme p«pirg 
©ertly rtlterate thiir stand in vari&ui £orw«. 

(d) PoBLtLm »t«t«»#nti preceded or fsllowtd by elabaritt inwoduo' 



to thf eruQial issues. 

(£) F©siti©n statatntnti but the paper fot» off tajigentially into 
tm&hn (si4rifyinf ttmfli pwional gripts, «te.) 



^ " Mfint a yoint of vitw arid offeg t miniaal dtfmnit . fhts© paptra ti 
atatt or iMofsfly imply a poiitlon but aithar giva only ©ns raaaon I 
if devtlopad) or f iva 2 or mora raaaons that art undavalopad. isora | 
«2" p4p#ri ofttn eonaiat of a ^ai^ of undtvtl^td arfumanta* Unli; 
acora point papairai tha aj-fumanta in aoora point "2" papara an 
to tha position they'va taXan* Soma aeora point "a** papara sight 1 
both a olaarly atatad poaitisn and davalopad i^g ^antaTI^ i^ay dl 
not damanstrata tha ability to davalop a ooharant parafraph in 
pypport of a topic aanttn^ai thm davalof^ant of tht argi^anta in t| 
p^p%^B ia, thar^fora, confuaing to tha rm^dm:^, J 



3 • Dafint a nd dafand a point of viaw , Thasa papari mskm thaiJr poaitia| 
and pjraaant aavaral wall davalopad argi^anta in aupport of thaiir pi 
Tha poaition can ba supportad throufh avidanoa or appaala to ganaifal 
to axparianear or to aoeiali acon^o, or paraonally hald valuaa* 1 
papara raflaet tha ^ility to davtlop a ooharant paragraph in auppd| 
a topio aantan^a. fhay do not, howavart daaonatrata adafuataiy thjj 
to organiia tha paragraph! into an ovarall organitational frasiawotk 
dissaniabla to tha itmmd^mitt^ 



4 • Systamatieally dafina and dtfand a point of viaw . Thaaa papara iafl 
of ^a oh«aetariatioa of aoora point "3" papars* In addition^ thaj 
praiant thair argwanta in a rank ordarad organisational fraMworkI 
diaearnabla to tha raadar throygh tha yaa of trMaitional aantanoaK 
phraaaa, or worda» mn^/ow linking of topio mmntmncmB* t£ a papar an 
of tha oritaria for a asora point ^4-- p^pmt axoept that it was prav 
in a claar organisational framawork othar than rank ordar (a.g. k^l 
of arg^ant) , it oould itill xm&^lvw a aeora point of ''4'% V " 
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mmnv TRAt T SCORING aiilhP 

"Movie tiAtLng" Essay 



th. rating i. ^ortj^t ar ^hy Jh'fn'f '^^'^"^^ wh/you thi^k 

thi. .wronp..t Mgumwtli"?.^"'" "xon9«t. Con.idtr giving 

i*«3ertMe«. org«nii.d to «vt*l thtir i-«l«tiv. 

th* rating ly.t.m i. importmt er why LTltiL .f^i*^"^"^ "hy you think 
"Oicid. wh.thtr yeu want to ,t Jt wlL^.^f"l>J '^'""^^ ^ ehang.di" 
up to yeur .t«ngt,ti een.idar putUw Si ^Jf ^Pertant id,, and build 

* *!J »^iftAon i.aay.^ Putting the «trenf«.t mxqxmmnt finti" and 

tti.ir point Of vi.w i« that^iy^/u^lI^LSP 'if * °' ^"u- 
•uggaata that atudtnt. m»t faaS S ^fr ?^* "fi^l»lning why..." 
th« ...«.d .tat«».nt 4."^h" S.M h1;i%:Jijirj^^ ^^^^^^ 
ff;^ •asition, th. .tattMnHli" Jfit^^T"* *^ ^""^ ^^^^ 
tienal fraaawork for their arguaaw" ^ ?" ""f^"*" M dtvalop m organiz.- 
te laa.t Unpertant. Th. finalatatii^f *^ ^o«»nt or aioat 

•^ha.i, of thi. writing wm bi I^^^!. Priwry 
M.ult, .tudanta .h^uld oJ^JeinSatf P^auaalvaT ul 

Md b. of It laut aod.r»i. l.^k J ^" '""•'"•nt with thi poiitlin 

georinq Sujda Cata ^ar><«. 



0 - M© faaponsa. 



' " ^^^^^M^mm ^' not 

«at«n,nt or ol.„iy iaply a poJiSIn b^'do^J"."*^ ^^""^ * 
raaaona to d.v.iep ttaif Lg,^;^ S^^ "^•"^ •UPPorting 

pr«»«nti ff«s.anta. semm ts^lcal aeora point "J" papar. 

(*) Attituda. and ©plniona about ralatad aoeiai i..... . . 

•^ataaant of po.ition«th... Iwi'LofJ?" * ^^'^ 

•tat.ffl.nt. of opinion ahowlng no e"™ fS J^J?^' 

•upportifjg it. concarn £©r taking a stand and 
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PRIMAJRY TRAIT §QOmm GUIDE 



"Video anffiQi" ES^ay 



T©p4£i WriM an tiiay praisnting your opinion on we of Wit issues iurrounding 
video g&iDgs. ihow how the data eoHteted from th© class qy«itlonnairt 
lupportid your opinion # eha^gtd your original opinion, or disagrted 
your opinion but did not eha^gt it. 

Primary Trait i Bsasoned pr^aentation of an opiniDn/hypoth©iii ^©yt social 

bahavior and a olaar, thoufhtful dia^ussion of th% rolt of rasaarah data in 
Minforeinf, iiodifying, or ehanfiJig thm hypoUiaaia/opinion* 

Batlonala f^r Primary l^ait i Stydanta oan dariva tht dirtctlm for thiir papers 
from two kay atatamanta in the topici . .praaanting your opinion on ona 
of the iaauaa awreimding vAdao famai'* ''Show how the data oollactad 
frw the olaia quaationnaira aupporttd your opinion, changed your original 
opinion# or diaagraad with your pinion tout did not ohMga it." 

The firat atates^ant indieatad that atudants ahould ehooaa only ''one*' 
position on an iasya ^out video fa»esi "praiantinf your opinion" suggisti 
that tha opinion ahould bm olaarly expraistd m6 poailbly alaboratad upon 
for tha reader t 

Tha aacond kay atatamant, ♦•Show how the data* * ^aupportad, . -ohangad your 
original epinioni**i" euigaata that tta original opinion ahould be atatad 
in aueh a way that it tan be csnfirBad or rafutad by data Cprob^ly aa a 
pradiotion, hypotheaia, or qyaation) . Tha aeoond atatasant alao ealla for 
^ analyaia/discuisioft of the data ai it affaets tiim atudant*a original 
opinion. «ia ralationahip of the data to tha original opinion ssuat there* 
fora be elaar to tha reader* 

Sinoa tha topic calla for the presentation of m opinion and its verfiea- 
tion through data Malysis. this paper is wwm Mnoamad with el&rifying 
the thoughts of the writer and infor^g toe reader thaji with parsuading 
the reader. Aa 4 result students should ooneantrate en being truthful 
and h§nast to the v^iter "voioe" rather than on fooussing on the faalinga, 
thoughtSf or responaas of the audienoa* 

General ieoring ^tionalei h position must be tMkmn in the papar and siust be 

^ " stated iii sueh a way toat it oan be oorr^ratad by data. In a eo&patent 

paper, the witar's rationale for the ©riginal opinion will be oonveyed* 
In addition, a diaoussion must be inaludad about the degree to whieh the 
data aypports tha initial position md why. ^o demonstrate o<^entenoa 
Cseale point **3**) all of these oei^wanta must ba present and adaguattly 
elaborated. Ixcellent papers Caeala point "4'*) will not only inolude, ^ 
all of the qualities of a seale point "3" paper but will be able to pull 
these elements together into a ooherent organiMtional strueture that 
makes the parts of the paper work together as a wholt (through the yse 
of transition pteasea, toplo sentences, ato.). 

Scoring Guide categories } 



0 « Ho respmse. 

1 • inaomsla ta oresentation . Some of these papera have not made their opinien 

olear. Others may present a diaousaion of data that doaa not "1*" " 
the opiniw. The pa^ra evidenee poorly ©rganigad or oontrolled thinking 
through the failure to fora elearly related ar^^nta or diswsiions. 
some t»ioal aoale point •'l- papers present! 
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^ ^^^*^^L^ 



^W^i^A. 




A^f^ 






ESSAY CM VIDEO GftMES 



■wrounaiflg video f«Mi and .hei^ ho*, th* data coUaet.d itm tht 

opinion, changad your origSL 
opinion, or di..gr„a with you* opinion but do,, not ohang« it? 

PW-WMWNG, a) ^ooa. of th. oontJova,Mi*l qua.tiona ^out vid.o g™,« 
that intaraata you 

Si^oJ/"* '"^ aew, your 

c) mit a prediction about what tha data will ahow (it might ba 
tha aaat as your opinion). ^ 

d) CoUtet and analyit tha data from tha quaatimn.lra that 
ralatei to your contrevariial queatlen. 

•) Ravlpe or •xpand your opinion bap«fl on the data. 
o.v.X^, .„ ^ „. ^^^^^ 

a) tfhe fuaation you ara addraailng 

bj Your original epmien/poaitlon on tha quaation and your final 
©pinion if It haa chang«a. 

e) What the data Indieataa about your original position (doas It fully 
■upport It? partially support It? dlsagraa with It?) 

d) Elaboration (Why do you think thia finding la trua or how tha data 
influanea you to ehMga your poaltloni or why tha data doaa not 
ehanga your opinion avan though it dlaagraas with it) 

ROUGH DRATTi Prapwa an assay fren tha outllna you davalepad. 

JmtSXQHt a) CritlclEB your rough draft i It la elaar? la It eo^plata? Hava 
I fairly rapraaantad the data? Have 1 avrsssad m position and 
deaeribed how tha data suwortad It or influanead it elaarly 
enough ao It will nalca sanae to s«aona else? 

b) Chesk your draft to be sure thatt . 

- the data you're prasentlnf relates elaarly to your opinion 

- you analyzed the data carefully and praaented it fairly (you 

didn t ignore parte of it becauaa It didn't agree with your pealtlen) 

- you give specific reaaone for the poaltioi you're taJtlng after 
Malyglng the data. 

- your points all elaaxly relate to your tepie. 

e) Have aoaeena else read your paper and give you auggastlons if you 
have tlM 

mnmQi try to have no sore than 3 technical errors (graaaar and spelling) i 
consult with a dictionary or sosaona else to help you with this. 

riMSL COfys Whita-lina paper pan, alternate llnea 

Fsugh Draft Duai 

Final Copy Duei _______ 
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(a) Opinion ■tatewent i» unrei-t**^ ,v 

opinion «««..„. 4. .l.bo,.t.Tll w r " 
(d) opinion i, .t.t.d ^ , , ^ *" " 

flc.nt portion of' tl,.°^,"^*ri,°? 'f!" " Out . .1^1- 

<l.v.lop.a. BOM typlcl .cor/jolw m»« 1^*""" " ■"•"'■"y 



(C) Clearly pM..nt*d but c^l.t.iy und«v.iop.d opinian „d 

poMibi^ «r . point "!^p«J--frfiK a"e.rft«ii. to th. «ad„. 1*11 

«at.«nt «d thoreugS .WlJatfSn ; d! J -^VWrt.d opinion 

' ' ^^^^^ c aspgnwfifi ■vteaatie-Al iy d«vel^-.-J 

eharaet«gi, ue« of teal. Point "3" b«bLJ' A«=iuat all ©f tha 

P«per.' •s^lanatien. Bay S ad.J.fe!^ ^'^il. «al. point "3 

Of data „«t ^. .h.^"^f^u.%%''Ll'e"\^%f «^l-f- - 

through u.rof%^,^f tIS tJ^aaT ^'""^^ ^ ' 

topic ianttnc.s. ■•nt.nca., phraaa., or word, and/or linking of 
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ftft isuOTOft**t:^f tin p*p«rs mtml)/ 

rtittMM ^mis «t«n4 in viyrioui for^i 

C.) . tfc^ndatleft Mi minimi pr,.wt*t4on •i^J^JJJl^^.^iJ^.r 
.ianlflv .i portion of tilt P»P** fO«« off tMfl.ntifclly i«w Anower 
(elMlfyinfl j^Monil fiiptfc, 

atw^ativts •HtMhily d*v#i^pts- S»t typiwl iMlt point 
M cruwly pftMnwd but eavltt.ly «ni.v.l^« p*...nt«ti«n «f »lt.«,a- 

p«.ff^h. into « ^'"1 « h.v. . MUil^ 

JST^^ « poMly eawtcttd concli^f p«.fWh. 

d«vtl«»«a. ©i«M ptptw all^ef j 

■ eoip aft fnf „J t" lXu mii. •xetpt tJi«» vhiU j 

ttks*r«* aiieusslJm and tuppert »«y e« •n»^»»*»« "* „ ^ 



Topic I mitm 



. " ^ writ,,., .uditee.. »"t«»nt id.nun.. Ldividu.l« 
io,ic.iiy foil* th. (liisum„ o« tht .itJrII«"Jr^ 

alt«ra«tiv*« 4„4 will ci«Miy b« f"^ ?■ *^ ^•mttim ot th» 
pull th*,, tes«th«?i«! * *• '""i' •l«beMt.fl Md 

. W.01. ctb.ou,h t.. t,a..itf:nHjf..t m ^.^^^ , 



0 ■ we M«pe«»«, 



i« lifht ©f u,,j,, ^ B*M« .^Jr?! «th«r thAft ew»ld«rinf than 

•len,. ^ig^ ^^^^^ p^^^ «f««»«t« di.e«- 



r.ec«,«datl„. f„ „«.t In Mrti.uUr. th.. ^11 eonaidtrln, «.-H,.r 

to .olie the trln h.„«.,„ .t„hl„,ton. B.C. .nd T«k City .i „u did thii ytir 
or tht vhol. 1„ .i,h.r Hm. Terk or W.^hln^an In „d.r to «n«nt«t. 

««r. en e„. ei^. ^^^^ ,hi. y^,.. ,,,,, ^^^^^^^^ 

'*rltt a litter to the Hougg x^A^ara ri..«.*4k4 * 

tn« nouia M«d§rt dBicrlbtiiR your tesratiienB pf whit York 

City tfff.r. .„d of What '/..hlogtoo. n.C, alf.r. to ^.lti„ .tud.nt.. fb.o 
indleaf your r«o««d,tio« fo, whloh elty or cltl.. .h^uld b. loaud.d in ««t 
y«ar'« trio. Glvt rMieng for your rtcotaB«od«tlon. 
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WRITING PROCESS INTERVIEW FORMS 

* 

1. T.V, Watching Letter 

2, Movine Rating Essay 

3. Vidtogames Essay 

4, Washington Trip Letter 



Interviewer 



sTmrnr interview form ^^^^ »^ ^^P^f 

W,t«r«" STfi** An Writing Curriculum Hm^ ^ 
Writing Proc.sg Inc.rvlew 1 gi^ss 



T««eh«r 



INTRODUCTJON! 

"I'm 



Of you w«i cho„n « random to liCi L ^0!^^^^^ f/J *bout writing. Sevtr.l 

I. SCNEML QUESyiONSt 

A. Do€s writing cob« •asijy to you? 

^' "i«,J'«;;f if" ^ writ.? do you wri^ Dfttn? Has .chool 
hftlptd Mk« it aaiy for you? tn what way, ate. 

H ^'i^^J^ ^"'^="1* 6' «i " writ.... but it ...s. 

to b. iisq^ertant to laarn...H.s it .var batn aasiar far you? 



B, What's easiest for yeu In acheol? 

ft Khat •ubjact i« ««.iait7 (if th.y ar, havinf treble) 



C. What's siost diffieuit for you in school? 



Note htra ©bsarvations about student's lavel of eoafort, eoaposure, ©penntsi wd 
approaeh, etc. during inttrvitw at wall at «i»y circTOatancas that might invali- 
aata this intarvlaw. 



2- Nasi® 



t>. White doftft writing fit into th««« #Htreme»? 

P. Whtre dots It fit between youir wsponse to tasisgt and noit difficult? 



What i« your £«v©fit« »ufc3«et? Why? 



r. G«ttinff b.eH ^.-tfltift,, what do yey find a*H«t you want to writ.? 

Pi Ar. th.t« ti»,« whtn you rwiiy want to writ,? wh»t ar* they? 



a. 



UndicMt Which e«€ frojn probes you ustd i which w„t •plntwlSsr 

- fttill&irity with topic or havinf tm look thinf i up? 
* inttrtit in topicf 

Fi itryeture of Aasignrntnt - it tmlU cltarly what it ti^tetad or iMvta 

it up to you? 

Pi Whirt you work on it - in clais or taka it hemt? 
Fi Tisa you hava to work on it * do you naid a lot of tiiaa? Mora than 

a olaas ptriod? 

raiouroaa * doaa it htlp you to talk about it with ^oplt? 

- ba ^la to look thinga up? 

^ do you prafar to work by youraalf with your om 
idaai? 

- do you like to look at othar witinf lika it? 



What kind of writinf do you lika to do tha bast? 
Fs Lattara (giva a sampling of pr^as) 

Journal icritinf 
Storiaa 
pinions 
Foatry 

Kasaaroh pa^r 



^"S* Nam© 



I. Hnv* f^JJ Had a t.ach.. th«t rwUy h*lp.d makt it tasy fo. you? 
F« Wha.. did he/she d© that fflade it ensier? ^ 



OPINION or TOPIC 

A. Is watching t.v. during th« w«*k a aubiect von h««. - ,i 

?i Do you really ear. about i^i iTl ^ " """"^ f«eliftfi about? 

y u r.aiiy ca*. about it? (get sensa of atrangth of yms or no) 

Ps &© your parants ear«? 



». What your opinion on tJie iaaut? 



C. vmat do othar paopla .«y about tha iaau. who mAght f.ti di£ft«„tly fr 



m yoy? 



i^HpEMma WITH TOii MBimmm 

h. Did you have a r«setion when you first read th* Ji«a4™m*^*^ ^ 

Fi xhtn what? tmq m« assignment^ What was it? 



1. How did y©y ga ateout aetyally writing your latter? 

What did you do first? ^ ^ setter? 

Pi What did you do ntjct, mtm. 



*** fft Tniti"^^^.^^ *" Anything lik» that bsfer* itartinq? 

use sii»e probtti!) mwi.Aoned, rafor to their taspoiim in 6 ajid 

Pi Can you i.itfrib. what they looked Ukt? Ware th«r« « lot of thett? 

f I Wiat did you ust thw for? Just to g«t thsughtt togsth.r? te 
organist youj pupsr? 



C. What did yeu try to aec^pliih in your letttr? 



"^^/'^^f"^'" ■^"^'^ " in ^^"^ thinking 

p. Could you afticribe what thiy w*r«/„hM hsppmnad? " 

> Fs What did you do? 



f or wrAting? 



{If thli WAS Mfiw«rtd in C, Juit skip ovtr it) 
f I In what way? 



F. llh«n you fot your paper baek tht ••eond day, did you maka wy Santas? 
Pt Why did you maka tMmmf 
iOmt an idea of hm$ aKtanaiva thay wara) 

Pi Would you hava wantad to maka mora ohanf as? 



Did yoy lika haw your witing eama out? 

Pi Was thtra a part or parts you wara partieuiarly plaaaad with? 
What was it/wara thay? 

Pt Was thtra a part or parts you didn't lika so wallAraran*t so 
satisflad with? What was it/wara thay? 



^fmm tou FOE TM^^m with i m^oim ^mTim ak^ ^ou mm h gmat hei^i 



Bat^ of Dat# of 

fiW&W;? INTERVIEW r0J<M interview ____ Asslonft^nt 

Waters" itm in Writin?j Curriculum, Name 



Writing Process Interview n cinss . Taacher 



"Hello . at'* nice to s«e you again, in ciis» you don't MCisll 

sy namn, I m , and, as you know. I'm working with th» 

■ehool to itudy writing iii»truction. today I'd Uk« to talk with you for 
« f«w ftlnutfti *i«ut th» writing asslgnintnt you Juit eo«pl«t«d tot fading 
writing workshop, l r.aliy apprteiatt your taking the tift* to h.lp ui ©«t. 

1. OPINICXi OF TOPIC 

A. I understand th«t th» topic of your last paper had to do with your 
opinions a^ut sovie ratings and rastrietioni. It this a subltet you 
have strong f etlingt about? 

Pi Co you r#tlly ear* about it? (f.t asnBe of «tr«n«th of yes or no) 

Pi 0© your parents car«7 



8. What i£ your opinion on the is«u«7 
Pi Why? 



What do ethftr people aay about the issue who mifht f.al dlff«r«ntly frem you? 



II. cmmcTim of assicio^jt mm instruction 

A. The last tioa wa «p©kt yeu had written a letter about watching television en ' 
week nights. Did you find this «aiigniB«nt either easier or more diffleult 
than that one? 

Pi Why do you think this is so at they have indieated a differenee) 

Ps Can you think what mifht have oade it easier? (if ths^ said »or« diffleult) 



9). 



2 flmi^ 



i«t kindg of things have you bftHh wtiting? 
Hov htvs yau felt About the writing you've bear, doing in cUun7 

uli .Jf'^ q^>«tion, you might waj,t to follow it up rioh? La 
by using thii psobm first J ' *^ 



C. P© you think what you'vt been dolno in eiaae <rifi..««- ^ v. 

th« p.per you Ju.t finiMh.d? ' i^»fluenesd how you wrote 

°' •Ptcific ejcamplBS, like th« things you 
paid •ptcial attantion to7 ^ 



E»EMK4CE Wlra THIS AISIGWKENT 

** ^"/"fhln'^Jhatr"'*" "'^ "•it~»nt? what was it7 



Hob- did yeu fo about actually writing your eisay? 
Pj What did ysu do firat? 

P: Wiat did yeu do nmxt, ate. 



C. Pid you aak. not., or an outUna or anything Ilka that bafora ttartins? 

Pi Can you d.aoriba what th.y look.d ilka? War. th.r. a lot of th.m? 

Pi What did you uaa thts for? Ju.t to f.t thoushts tog.th.r? to 
orfanlM your papar? 



3 Na^e 

What did you try t© nccompUih in your essay? 



Pi What d4d you d©? 



" mIJ USJ? °' " Of h« .xt.n.lv. 

Would you have vuud to nua mora chlngai? 



«• Pill you Itka how your uiitlnj eaaa out? 



••THANK you FOR tMmm WITH m, VOU raw * GREAT HELP armTM. , 
TO TAUCINO WITH VOU IN A FEW HONTHS. ^vj fltLISioSf^' ' 

Nott here observations abaut student** i**f*i — 



Ifttftrviewir 



Wattrf • BTtPB In Writing Curriculum 
Waiting PitmmUB Interview til 



Dat^ Of 
Inttrview 

Name 



Date ef Papar 
Assignnffiiint 



to .tudy writing inswuctlon. ^-Dday I«d Uk, to t.lH with Joulor^ fJw 
wiJuSo vrlting *„4gn«„t yo« hav. ^ust b«n warL^glJ Lading 

writing Workshop. I really .ppr.ciats your taking the tijat to help ub ©ut. 

I. OtlNlSN OP TOPIC 



A. 



L^f"«K^*;\*^'' *f ^ ■ haa to do with your pr.dlc- 

Di viaeo. fames something you havt itrong fealing* about? J 
Pi do you really care aJbout it? 



B. 



What was your prediction atout videoganei? 
Pi Why? 



Did you find that the respDnsts to your queitiennaire differed at all fr«n 
your prediction? oaa zcom 

Pt In what way(E)? 

Pi Hew do you account for that? 



Note here observations about studtnfa level of comfort, compo.urs openness 
and approach during interview as well as any ' coB>Posurs, openness 

this interview. 



circumstances that might invalidate 



ERIC 
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2 mmm 



21. coiiiiECfiON or hBBtmmm with iHsTRuetiON 

h. !rh# iMt timt ^l^okm you had written a pgpcr mbout siDvit ratiri^i ^nd 
r^PtJfietions. Did you find this amBigrmmt m videogajnes either eaiitr 

mora difficult that tht on© on aiovi© ratings? 
Pi Why you think this li so (if thay havt indicated a difffirtnot) 

(If thiir general rtsppns© to the prsba doep not incXud# th« following, 
ask thtffl as probes i 
* Which topio intsrssted you more? 

Which topio did you havt m©2f# to gay about? Why? 

- Did tht other work you»v# dont in the course make a diff#«net in 
how hiufd or easy this aisigni^tnt was for you?] 



B. Have you hmmn doing a lot of writing and organising for writing in yaur 
m^a^ng Wrat^^g Workshop in th® last aonth or two? 
Fi What Jcinda of things have you bmm witing? 

Pt How havt you f«lt about tht writing you've btan doing in clasi? 
I2f atudants hava shown a lot of affaat in thair initial raaponat 
to the intarview question, you sight want to follow it up right 
away by using this probe first] 



Do you think what you*vt bean doing in elass influenced how you wrote the 
paper you just finished or are just finishing? 

Pi Can you think of any apeeifio aMamplts, like the things you paid 
apeeial attention to? 



A, At what stage of your paper are you right now? 
Pi First draft? cofl\pleted paper? 



3 time ... 

B. Did you hav« a reactlen when you first li.»rd atoout the reittareh assigmf.ir.t? 
What w«8 It? « 

P. Then What? (Did you ksep on feeling that way or did your fetlings change?) 



:. How did yeu go (or ere you going] nbout actually writing your •s.ay? 
Ps What did you do first? — ~~* ssK.yr 

Ps What did you {will yeu] do next, mte, 

IHott to lntervltw,ri whtn r»-copying, pleas, inelud. any of tht.e ewments 
that aniwer other questions under the appropriat. quastions as wtll] 



4 



Did you maJie notes or an outline or anything like that before ■tartins? [If 
prober? ^" ^' ^' ^^ntLomA, imUx to their raaponse in C and u*« same 

Pi ean yeu describe what thay looked like? Mere thera a lot of thMs? 

*i What did you use them for? Just to gmt thoughti tofethtr? to orfajsize 
yeur pap#r? 

Pi la thia what yeu nermaliy do? [If nott Why did you do it this Uaa? 
Wag it helpful?] 



What did you try [are you trying] to aceonplish in your eisay? 



Did you find it diffieult making a prediction? 
Pi Why do you think this was so? 



4 Kme 



^M..«Li;:'?^„%:fj.it.i,'^' » y-" topic 



[us. en. of tte feliwing tuestisnsj 



about «i„g ««t ^il^u^ ^ wa?f« ih^" "~ you to 

ew ask, Did you use tht s^^lwaSL^f f '! *o«he«i„g, you 

*i Bid you find it .a^noush S iritl^SS """'^ 



yeu daseriba what they ta^aj/what h^pan.d? 

imat did yeu de fwiii you dsj? 



n.i. qUMtiOB i. e„ly ,„ „ ^^^^^^ 



K. Did yeu yeul have any ^iperttinitui to revi«* your paper? Khat wer, 

thty fwiii they bej? 

Ps Did you Cwiil yeul aake ehsnfts? ^y those parttenlaf chsngM? 

Pi l&at klnas of ehanges did yeu Iwill you] sake? Iget an idea of hew 
extensive they ware er wlil l^j 

Weuld you have wantad to m^m msxm chanfes? 



I*. Do you like how yom: witinf ease lis c«intJ out? 

Pi Is there a part ©r parts you are partieulariy pleased with? What is 
it/are ttiey? 

P5 IS there a part or parts you d^'t liXm so »#ell/«en»t s© satisfied 
^ with? What is it/are they? 



"TOJWK VOO FOR TKJtlNS WITH JEi VOU mm A GWAT Iffil* A»im 1 MOK POWOLM 

50 T^AJaNg WISH yeu ih a mqnto or so. are you ootm to issbihcton mm mmj 

HAVErONI" 



■ STUOENT INIERVIEH FORM iStlr^Lw D«te ef Paper 

____ ^Bigmmn% 

H»ter»VSlEPS la Writing Currleuim Maat r.; 
writing ?roee«« Interview IV amsB Tg^rter 

^'nM.; I«a * to -ee you again. In ease yeu den't recall 

« few^notes about the witino 4 *® with yeu for 

Hritint ««kshop/«ntUsh!'TJLSJ'^LiS 

Ul out. - ^i'MGis^e taXinf the %^ t© htlp 

" ^^^^^^^ ^^"^ 

^ CM dif ferentj Ifliat do you ttlnk aceowt, for the ohanf e? 



8. In Septe^er yeu also indioatod that 

•ehool. I. that .till the easa? easiest for you in 

(If different) what is easiest? How do you aooeunt for the ehange? 



e. Vou also indieated that was ma-t- , . 

Is ttat still the ease? ^ifWeult for you in sehoel. 

(If different) What is ^t difficult? Ha« ^« , 
ehMge? *" «.«i3.euit7 How do yeu aeeeunt fer the 



B. (Ask if you ean't already tell frei« the responses to ^estiws A-e) 
Where does writinf fit into these extreaies? 
9t Where does it fit between (C £ B responses)? 



Hate here ^servations about student •« lew^ ft^'ZIZ*!!*""""*' 

approach, ete. dicing Intarview M ^eL rl Lu f ' eoi^iure, openness, «€ 

this interview, interview as well r,« „y eireuBstanees whieh may invalidate 
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-2-- ■^■'■' Naae 



£. J« still yeur favorite sidajett? 

^* ^«Jid?*""*' »h«^ is yeur faveriw .^jeet? why ao yau think thi* 



P. Settiuf baek to writing, what do you new find nakts it •asier or harder to 
oe^leM a writinf aasifnaent? Clndleat. whieh o^ fron prebas you usad ana 
which were •pontaneous) 
Pi Topie - choose yourself or hava it asslfned? 

- faniliarity with topic or havinf to look things i©? 

- interast to topic? 

Pi Structure of aasignsent - it tells clearly i^at is ai^ctad or leaves it 

UP to you? 

Pi Where you w^k en it - in class or taka it bmmf 

P.- Titta you have to work on it - do you naad a let of tiaa? itore than a class 

paried? 

Pi using raseurces - does it help you to talk ^ut it with people? 

- to bt Mtolm to look things ^? fatter data? 

- do you prefer to work by yourself with your otm ideas? 

- do you like to look at otter witing like it? 



C. (Ask if not answered already in earlier queatienB) 

Mas Beading Writing Workshep^glish Bade i^iting My easier for you? 
p! Clf yes) What happened in the course ttat it aade it easier? 

Pi (If no) Did it sake it sore difficult? *my do yeu ttink ttis was so? 



©PINION OP TOPIC 
A. 



yerw'n':^^.!^: 2itrrii"^^rtti%s*fii t*^' «-kshop/Engii.h 

-here y«„ ttink ttHtt gridi^SouwIo fe^ ^ UiV^^ ^'i"^ 
a sohject you have strong feelings Lout? ^ ** 

P« (Try to get a sense of th, strength of tte ye. or ne) 



ERIC 



lOU 



*p" ^f'*' 'or th. beat Sth grade trip? 



C. What ^tht «h« peepu .ay about th. .^o U.l di«a.a„«y 



SI. '.eOHlffiCTJQN OF ASSISMffiOT lara IHSIR 
Fer Readine Writing Wa rkghep 

imic^ t^ie dia yw hav« Mre to say abaut? Why? 



For Sngli gh atudgnfeg f 

^1 In what T%Mpm^ts7 



can you think ©f any •eaeiflc •xasslaa life. *.k- *w* 

attantien te? F»=iiic axaqpiaa, ilka tha thinga you paid 
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erIc ^ 



-4- Name 



x^^ sxnssE»cE mm THIS tssimt^ 



*• "^Sen'^It'^mli^ """V "^isn^n« What w.s it? 

P. ©ien what? (Dia yeu k..p m ftelinf ttat My or dii your filings ehiw,e) 



8, How did yeu 90 abeut actually writlna yeur •««ay? 
Pi What did you de first? " 

fs What did yeu d© naxt, ate. 



that «n«,,r othar v^MtiMS mdtr tha app«pri«t« ^ufitiiia as wtur^ 



C, Wd yeu Bake netas or « outline or anytlaSs ik* . to^fe^. itarting? 

"L:i4^:tr' « »wn*ie„.d, r«*. t... u.. 

Pi Can you daaerttw what thay lookad Um^ mm twf* a lot o£ thaa? 

^^oufp.J^?''*' '**"''^' Ju.t m ^oga^er? to organii. 
Pt {Mfar to aariiar intarviewa her»i 

AS 2 rifht? flf Boti Vhy did yeu ,fc ttoe? uid Has it helpful?) 

«?i:.i"hiS€ui?r"'' ^"'^ ' 



B. What did you tsqp to aee^plish in your latter? 



"J P^^l«»/fet stuck at any point in your thinking or writing? 
Pi Could you describe what they were/what h^pened? 

Pt imat did you do? 



ERIC 



r. Did you have my oppertwiitiM to «v4se y©u^ paptr? Ifeat wtM they? 
Fi Did you make Ganges? Why thase pM'tieulsr ehanges? 

What ktods ©f ehangea did y©u sake? (fra»ar, ideai^ etei t^ to get 
ideas ef he^ extensive they were) 

9t Would you have vanted to m^e My Mre ehanfea? 



Did you like hw your vritinf wsm out? 
Fi Was there a part ©r pa^s you were partiouli^ly pleased with? 
miat was it/were they? 

Pi Was there a part or parts you didn't like so well/weren't so satisfied 
with? l^at was it/Were they? 



OSWIHG to mm TOU* aO» woe on YOUH EXAHii 10® »V1 A NICE iUMJ^R,^ 
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APPENDIX D 



COURSE EVALUATION INTERVIEW FORM 
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STUDENT INTERVIEW FORM Namei 



STEPS In Think! ng/Wntfng/Probltm Solving Placej_ 

Wayland Reading/Writing Workshop Date/time: 



INTRODUCTION r 

Hello. My name Is Dr. Shann. Thank you for agreeing to meet with me. My 
purpose In talking to you Is to get your opinions on how well a program of 
instruction helps students learn—which activities work and which ones don't 
work. I d like to start by asking you some questions about school In oeneral 
and then focus on the Reading-Writing Workshop In particular. Your opinions * 
are Important. After all, students are the ones our school programs are 
supposed to help. 

I. GENERAL questions.' 

A. How do you feel about going to school? 

Probes: Is It a waste of time? 

Is It always great, fantastic? 
OK, somewhere In between? 



B. What do you like most about school? 
Probes: Nothing? 

Anything else? 



C. What do you like least about school? 

Probesi Nothing you really dislike? 
Anything else? 



0. What Is easiest for you in school? 



I. What is most difficult? 



Note here observations about student's level of comfort, composure, openness 
and approach during Interview as well as any circumstances tnat might 
invalidate this Interview. 
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QUESTIONS SPECIFIC TO RRW AND STEPS 



ifLi,'^"if ^^^ W^ sptclfic quistiens about ways ef ttachina and 

vau 1 LJn hIJf ' "r|Hsncti, and ways of organlzf ng Ltirllf s th!t ght he! , 



11. PERCEIVED PURPOSE OF THE CURRICULUM 



A. 



L frJ I"® Readlng/Wftting Workshop Is suppostd to htli 

you difficuUlis in (Use as appropHatt what studen? 

namtd as difffculty In gentral responsts about school ) "''^"V 
Probesi Is that how you stt tht courst? 
Is It broadif than that? 



8. 



What do you think Is tht pur-post of tht courst? 
How Is It suppostd to help you? 



Let mt ask that qutstion a llttlt bit differtntly. If one of vour 
Jtll?ibeMf what tht courst was all about, how woSld ylu^^" 



^Wgoals"xp?;c?l?)''''' """" *° '''' '''' 



D. What ptrcentage of time In the course Is glvtn to: 

1* Reading % 
I. Writing % 

3, Thinking % 

4, Othtr % 



F. 



What kinds of aetivi tits would you include In tach cattaorv? 
1. Rtadino 



'9 

2. Writing 

3. Thinking 

4. Othtr 

G. Wtrt connections made bttwetn thtse areas of the courst. or were 
they taught as separate activ1ti«s7 



H. What was a typical class ptriod like? 
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III. SELP EVALUATION 

A. Has tha Retdlng/WHting Workshop helptd tn ^rw of thise areas' 

Prebesi Any help? 

In what areas have you Improved? 

B. Can you say any more about how this course hag helped? 



IV. TRANSFER VALUE 

A. Has the Reading-Writing Workshop (and especially the STEPS portion 
helped you 1 tarn better in other areas in or out of school? 

Probesi (Chtck if used. List responses, prompttd or not. in 
appropriate spaces.) 

^I. Other courses you are taking? 

3. How about in other things you do outside of school? 



V. AFFECTIVE OUTCOMES 

A. Oo you ftil any more confident now about your abilities In school? 
(If yes) Can you explafn why you fetl this way? 

B. Has the course affected whether you'll attempt a difficult 
assignment, or how long you'll stay with it? (Motivation, stamina) 

C. Sptciflcally with rtspect to writing assignmints, has the Rtading- 
Wntlng Workshop made writing any easier for you? Is it less 
stressful for you to do a writing assignment than it was at the 
beginning of this school year? 



D. 



Do you think this course has made you learn mere Indtptndt 
without as much reliance on the teacher? 



VI. TEACHING STRATEfilES 

A. Is tht Readfnf-Wrtting Workshop taught any dffftrently from the wi 
most of your othir coupses are Uug 
Probes: How Is that so? 

No dffftrtnce it all? 

How about In the way the teacher treats you? 



(As appropriate) Do you like the different way of teaching? Does 
it help you learn any better? s wes 



C. Could^any teacher teach a course like the Reading/Writing 

Workshop? (Are special attitudes, diagnostic competencies, or 
particular knowledge required?) 



STUDENT INTiRACTIONS 

A. Do the students in the Workshop course react differently to one 
another from the w^y they do in most classes? 
Probesi How Is that so? 

There Is no difference? 



B. Have you learned anything f rem othtr students In the course, or do 
the knowledge and training come mostly from the teacher? 



C, Is that so In most of the courses you take? 



0. What kinds class arrangements do you use for Instruction in the 
Reading-Writing Workshop? (Check) 

Probes: ^, Whole class 

z , Swall group 

__3. Pairs 

4 . Individual work 

E. Can you rank order these from most to least used arrangements? 
(Show rank order in area to right of above question.) 



F. Do the group arrangeraents allow some students to "coast* whi It 
others do the work? 



VIII. cuss &m 

A. Were there few eftough students In the course for you to get 
personal attention from the teacher? 



B. Is personal attention from the teacher necessary? 

IX. LEARNING ACTIVITIES 

A. Of the ixtrclses, actlvltits, and assignments you've done In the 
course, which ones did you like? 

B. Which one didn't you like? 

X. STUDENT RICOHMENDATIONS 

A. Would you recommend any changes in the course? 
(Elicit here unprompted remarks. ) 

B. How about In the content of the courses? 



C. How about changes In the relative emphisli (time) given to the 
different areas of content or sktns tn the course? 



0. In the number or length of class meeting each week? 



E. Who do yeu think should take the course? Only certain types of 
students, or everybody? 



F. Is there anything else you'd like to add about the course and the 
things we've talked about? 



THANK YOU VERV MUCH. YOU'VE BEEN A GREAT HELP.' 
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SAMPLE APPLICATIONS OF THE "STUDENTS" 
OBSERVATION SYSTEM 
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Pat e j/S'S {^<4 SfEps/non-STEPS 5rK/*S 

' ■■liilil iin. - - - -r-- 



— woBtrv^r . ^. — «>a^Tf„ ^ y ■ « of scudsncs 
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Physical Arrangement^ 
Topic (i) /Activity focus 
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APPENDIX F 

COMPILATION OF RESPONSES TO THE STEPS UNIT VII 
COURSE EVALUATION FORM 
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.Aim 



mspomzB TO coumt evaluation foeh 



What wai t he tagifest part of thp c mxBGt tor youf 

- categorizing and solving mystcriei 

- having my qmutiom answered on th« computer 

• thi writinf BBmignmentB 
dit reading logi 

- finding susweri to word Mlatlonships, math raasonlng, recDnntructing data when 

written in uttps y v@ wnon 

- reading logsi writing storits 

• tht packets wt did Uniti 

- problems with 00tectivt Kurdley, etc.i it was fun solving them 
som© of the drills 

- tht writing ikillsi thay were aasy and im to figure out 

• #12 gritty mmh the ^ame 

' tiffits whtn w@ had writing mBigrmmtu 

• Biath reasoning 

• th# story and then you did tjie quefetioni 
reading 

reading logi 
writing asiignmtnts 

when we used the computer it just wan't easy, it was fun ^d eKciting 
writing assignments 

reading aloud in class plus doing ihort associated assigmnents on readings in class 
math reasoninf 
writing assignraents 
raading, plays 

doing worksheets on analogies, etc, 
reading books 

short mysteries becaise 1 always like mysters 

the reading we had to doi it was easiest because 1 like to read 

problem solving 

reading itories 

reading logi 

Bomm of the writing assignments 
problem solving 
analogy problems 



2 



drunk driving project 

- th© little #iiays and reports 

* Itiith reaioniiif ma stories with hol@i 

- raadiftf thorn stories and the assigmnants 

- th@ "rounds*^ in baseball gmo problem 

* tht math rtasoning problems 

- rending logi 

' ghilt was thg hardtst j^art of the gourse. for ynuJ 

- reading and trying to keep up with reading logi 

* reading logs 

^ solving verbal i^taioning prpbleisa 

* the tests and reading plays out loud 

- word problemi and detective stories, finding key words and phraiaa 

- solving problems 

* the writing assignments sometimes 

" "over'ind ovef ^^^^^^"^^ «^ ^^^^^^^ I had to read them 

- problably reading, because I'm on off 

- some of the stories getting all of your Informaticffi in order and all together 

* putting data in essay of videogaros 
*■ o^puters and reading logs 

* careful reading 
writing the stories 

* writing 

- questions on stories 
^ reading logs 

- mostly all of the work like testing and worksheets 

* math reasoning 
reading 

- outside writing assignments that I*m not interest in 
analogies 

« getting to school on time 

- long boring wrltinf 

* doing questions on the readinf 

He' ■ 
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« writing part, btcaug© I never really could write 

- for mm it was doing the easayi in the beginning, but na^ really nothing coiaaa hard 
the mystery problemi 

« writing essdys 

- writing assignments 
" raading 75 jpages 

- nisays 

planning imd som© writing 

* videogaineg 

- getting tht ^adding dena 

- reading 75 paggs mvm^ week 

* the Writing aiii^iatnti 

- there wasn't any really hard part of th^ eourae for me. tf there wa^ it wai *'Hed 

Cjfbising tht miiart" 

- writing a fluent studant log 

* praetiet tagtg 

- reading log^i 1 raally wain't Interested in doing them 

Was there any section (s) that y©y felt were @spt0ially worthwhile and should always 
be in a gourse like this? 



" Units on Drunk Driving, laovies and other various writing assignments 

- reading books and writing essays— loved reading all the storlei/plays**wanted more 

« the major writings on oertain topioi (but have a ohoiee like ItogDonald's) and - 
similarities 

" keep doing the reading logs 

" ^^^^ important thing was regularly doing writing assignsentsi others were finding 
relationships, making charts or drawings for math reasoning problems 

- reading logi-*! though they helped my imderstand the book more 

* no 

- all sections helped us 

* all pretty good 

* it is very food to have a course like thifr y©u learo a lot from tht writing skillsi 

there should always be this course 

* the essays good to learn to do ever though I didn^t enjoy them 

- the problems* They teach you to look at the problam more carefully 

* caraful reading ; 

* the stories with holesi I leanied a lot frwi them 

- drunk driving 
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^ iim as It is 

- when w@ ui©d coraputer which mB a good eKperienco 

* eareful reading probltmi 

* reading and writing 

* ^ "Jding itQ' ^as aloud As good because everyana get^ to know aaeh person 

fL ^"""^ ^''^ ^^^^^ ^^^^ question^writing assignment tm that topic ig 

good feeeaus© wa wart able to help eaeh other- 

* math reasoning 

* reading 

- plays— it helps reading ski;ii 

" math reaioning and anlogies were fun 

" reading is very Important i have future kids read a lot 

- all aeetions were helpful and worthwhile to us 

- the mini^^ystary unit was worthwhile begause they were fun to figure out 

- notre'ally 

- I think the problem solving was an exeellent idea 
« no 

* problem solving 

* yes, the deteotive and analogy pr^lemi 

- all are sections I guess were ioportaiit, espeoially drunk driving 

* yes, learning hm to put together a report 
stories with holes 

- the writing and unit assignments were ve^ helpful in this course 

- 1 think the mystery problems were worthwhile because it teaohes students how to 

figure out problems 

- ¥ei, 1 think toe detective type problems should be left in because they make a 

kid m brain always be on the aler^ md thi^ing 

- practioe tests; they were good he If on the final 

- writing assignments and reading in class should always be in the oourse 

Was there My section (s) of the course that you felt were unnecessary and should be 
,iext out another year? _ 

* no « 16 student replies 

* reading 7S pages per week 

- reading logs Md being interviewed on essays you write 

- Shackletw story 

-Do different kinds of writing stories, like maybe make believe stories 

";^f^^i?5^9f^ ^ mf^i^ ^atings-they dro't really affect anyone and were boring. 
Should pi^ more interesting topics next year. 



- lOBie writing asslgnfflanti because uome boring. I'ry to come up with mor^ 

interiitlng assifnTOgnts 

- aiialetiei because they didn't »eem to help me muah 

* keep avof>'thing 

* n©i but don't do as mueh study skills work 

- the story on video games 

* reading logi 

- tha only thing I donU understand is why we did those reading storlti with quiiti 

- tht tisay on vldeogajt^s and some of the other topios you had us writ tssays on- 

Drunk driving was good, though 

- weekly reading logs; it should bB bi-weekly 

- videogajtiai sheets 

* unimportant set topies like vldeogasits or movie theatres 

- drunk driving asslgnnient* reading logs 

- videogames thing 

* I didn't think there was one section that wasn't helpful 

Was there any seotion(s) that didn't have enough problems or assignments in it to 
enable you to learn much of anything? 

* math reasoninf should have mora problems 
oategori^ing 

Did any sections have too mugh material so that the skills learning beoame boring? 

* too much to learn sometijses 

* videogames uninteresting 

* reading logs 
« rtading l^gs 

■ videogames other set topics 
^ don't do as much study skills work 

* short mysteries got boring after awhile 
^ mysteries 

* essays 

Has the w ork done here helped you in other courses you t^k this year? 

* Ves with no specifica ^3 

- iome "2 

* Not Sure « 1 

- Ho * 6 

- Engllih •IS 



- Science ■ 1 

- Math - 2 

- to look more carefullyj read twice 

- in writing reports and thinking probiems out 

Do you have afly ethe r comtnentB you would like to make? 

- Reading logs should be verbal 

- We had pyaetieally no work out of class 

- We didn't have enough problem writing 

" f*fh "Ctlon you could give other homework besides readin 
tinlihing a book more of a goal 

- I like this year's reading better than last year 

- Math reasoning sort of hard and got me confused 

• mybfi make logs more frequent and lower the nun^er of pages 
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